The reason as for why the atmosphere exerts a force or pressure, force over a given area, is because of the particles of Gases within the air, oxygen, carbon dioxide, nitrogen etc, all constitutes air, and the weight of air is ultimately what exerts pressure.