That is because in several states the people chose to have slaves. The idea was that if slaves are to be freed it shouldn't be up to the people but rather the federation, because the people will just vote to have slaves because it suited them to increase their wealth.
Horses
Sugar
I think I feel like there’s more than that but yeah I hope I’m right if I’m wrong I apologize
They were a different race and a different religion