According to the British Medical Journal this heat-loss myth probably came from experiments in the 1950s when military researchers exposed subjects to frigid temperatures.
This also explains why when babies are born they are given a small beanie to keep their heads warm.
The basis for physical fitness is having a good eating habit, which means to know what you are eating and to eat cleanly. Exercise at least an hour every day and drink plenty of water throughout the day.