Im confused by your question
The word <em>the judge </em>is used as indirect object in this sentence.
When there are two objects in a sentence, where one is direct and the other one indirect, the rule is that the first one is always indirect, and the second one direct.
The suffix "infer" means an informative guess from evidence or reasoning.