While it is true that flying requires good judgement, I'm not sure it's any more taxing than, say, motorcycling.
Mary and I rode coast to coast, Canada to Mexico, for many years. In those many thousands of miles I was always keenly aware of the consequences of letting my attention wander for even a few seconds. Gaze too long at the scenery, and your front wheel goes off into the gravel. It's all over, then, at 60 miles per hour.
Compare this to flying, where I may spend many minutes circling a target, taking pictures. This is often done no-handed, and my attention is focused on getting the light and framing just right.
Do THAT on a motorcycle. lol
No, there is a bravery with launching oneself bodily through the sky, but it's largely psychological, and has little to do with exceptional skill. The sooner we acknowledge and publicize this, the better chance we will have repopulating our ever diminishing numbers.