The main concern is that thousands of them would volunteer for the war to try to gain freedom.
Benjamin Franklin feared that if the colonists did not unite to repel the French and Indians, then the colonies would be forever "split," since the French would take more and more land to the east, along the coast.
