Because they were racists. They viewed them as slaves and property, and when they were freed, they viewed them as animals and segregated them. They wanted to find all possible ways to remove them from the society
Probably being poor and not being able to provide for their families