To determine the result of something, or a scenario before it happens.
"Either thou (Tybalt) or I, or both must go with him (Mercutio). This (the fight) Shall determine that."
This pretty much means that Romeo is trying to get justice for the death of Mercutio, and he would rather die than let Tybalt live.
