Back then, people needed to gather their food or haunt animals, if it was necesary for them to feed themselves. It is because of that, that they developed physical abilities to be faster and stronger. It does not mean that they did not engage in recreational activities or exercise, but those were not the main reasons for them to learn to use their physical abilities.