While this question seems more opinion-based, my opinion is that it is your responsibility. I understand the fears of further mistreatment, but are those fears worth not speaking up in the first place? A lot of times, nobody will know it is happening to you. Bystanders will not always see. The only person who knows what is really happening to you, is you. Therefore, I think it's your responsibility to speak up for yourself.