If they were farther apart they would be able to slip by through which means that it can go by faster. If the atoms where closer together then yes they would be able to go by slower.
What material structure explanation lies behind the fact that the propagation velocity of longitudinal waves is the lowest in gases and the highest in solids?