It IS fair because one person may have done something really severe (e.g murder) as a first time offence, which should definitely result in jail time, whilst another person might have done something that isn't anywhere near as bad such as stealing something smallish.
Every crime may have a chance to either go reported unreported. Reason being is most crimes are private and everything discussed about a crime stays in the court room.