Whom should be used to refer to the object of a verb or preposition. When in doubt, try this simple trick: If you can replace the word with “he”' or “'she,” use who. If you can replace it with “him” or “her,” use whom. Who should be used to refer to the subject of a sentence.
The speaker use the words they and we as if he was giving a speech to young black men. They is refering to the white men we is refering to the black men.