He refused to change because he was being mistreated. He told Rickey that he could not change, because that was just part of who he was. He reassured Rickey that people would eventually accept him because he was a great athlete, in spite of his flaw.
