The angler's hat has two very important uses. The first is there's a chance to not reduce the number of fish in the pool when catching.
The second is perhaps more important. When passing a fellow angler, you can participate in the age-old gesture of doffing. No words, just a silent acknowledgment of each other's presence as you partake in a doffing custom that has spanned centuries.