I believe because it is made up of very small particles that it's texture is naturally rough and coarse. In addition, when having to get rid of sand from your foot or in your shoe, it is tedious and a bit difficult to get rid of it completely
Some minerals can form from the air combining with substances, they can form from igneous rock, and sometimes minerals can re crystalize from metamorphic rock