If hes just being rude, honestly just stay in your room or something until he leaves, or maybe even tell your brother about it so maybe he'll say something to the friend. if he keeps bothering you even after all that, just tell him to leave you the FU€K alone. best of luck!!
As Tybalt agrees to withdraw, he threatens that although he is backing off now, the next time he sees Romeo he will not back off.