Many diseases need large population to survive. Hunter Gatherer populations are low. Diseases often affect and kill a few people and then go away until the population comes into contact with someone else. Most areas especially cities have a large population enough to keep diseases staying around. Disease does not spread faster in an agrarian society, it spreads but it is not too noticeable.
