All Southerners/Northerners did not agree/disagree with slavery. Some of them fought for the opposing side during the Civil War. Some reasons why they stayed where they were are that they were loyal to their state or they had certain advantages for them. Such as a buisnessman in the North, there is no advantage in the South due to the tarrifs.
