Fear of driving can set in at any age and at any point in time, but it is common to experience anxiety or a bit of fear with driving after a wreck. Especially after a bad crash or being injured, it is very reasonable to be afraid of getting behind the wheel again.