Tom is a compassionate man, but the crowd doesn't seem to believe him at all. Mostly because of his color. You might consider that it was a mistake that Tom was capable of feeling sorry for a white woman while the whites "should be the superior race". They were really bothered by what he said and felt like he crossed a line.
