I’d say, he didn’t really care about how he treated her because he didn’t understand. But now he’s looking back and now he feels guilty
The connection that the author Ralph ellison draw between symbols and language itself is that Language is naturally symbolic. The exact same words could carried out a different meaning depend on the context, and who are the participants.
Hope this helps