Yeah, Geralt can lose a large chunk of his health simply dropping fairly small distances, especially considering his supernatural (not superhero) physique.
Yesterday, I did a quest, Mysterious Footprints or something, involving a cave which was only accessible through a whole in the roof which you have to go through twice! Even rolling and using Quen (which doesn't seem to help) still meant he lost enough health that I had to wait each time while Swallow took effect.
It's not instant death from 20 feet falls that bothers me, it's the large chunks of damage from falls that an even an amateur gymnast would find easy that irritate me.
---------- Updated at 12:42 PM ----------
That's not true.
Jumps from at least 4 meter height and only loses half vitality without doing a roll at the end.
If you roll on landing you reduce fall damage. (Played on Death March!)
I get hit three times on Death March, I'm dead.
It's realistic.
And I want realistic fall damage.
Hmmm, that video looks perfectly reasonable but it differs to some of the experiences I've had. Maybe the way the game calculates damage is a bit erratic. Also, in both those falls the player actually jumps first. Interesting.
Without testing I can't be sure but now I think of it, the times when Geralt seems to take too much damage is when he actually falls, not jumps, from relatively small heights. In other words he can jump large distances, as in the vid, and not take too much damage but if he simply walks off some places he can sometimes take much more.
Honestly, I have walked on a tent like market stall (don't ask) and clipped through the material and lost almost half my health. A fall of 9 feet or so. Same for dropping through attic doors, cave entrances etc.
Also, an option to lower yourself to a hanging position before dropping down, as @
whitelion1284, mentioned would be great. Or maybe Geralt could crouch and place one hand on the edge before hopping down. Like when he jumps over fences.