They felt their job was fighting and government not being farmers, miners or the like. They counted a great deal on enslaving locals to do those tasks for them. This was mostly fatal for those Native Americans that were not previously killed by warfare or disease.
