The Brotherhood is the Masons or Freemasons, a powerful secret brotherhood that still exists. Fortunado asks Fortunado if he is a Freemason. When asked if he is in the Masons, he replies with a gesture the narrator considers rude because he is not in the Masons and does not understand it.
