I think that fear is perhaps more not fearing the action, but the outcome. People are not afraid of flying in an airplane, they're afraid of crashing in an airplane. People aren't afraid of guns, they're afraid of being shot. In the same manner, I feel that perhaps people aren't afraid of the fall, but that their reaction will not be right and they will be injured.
Cut off the worrying thoughts and everything's a lot easier!