We used to run panel interviews with everyone in the room. Whoever spoke first set the tone: one "weak on architecture" in minute two, and the rest of the hour was the rest of us agreeing with it.
Now each of us writes a verdict before anyone speaks. They disagree far more often than we expected, and that disagreement is the part worth discussing. Your own process probably rewards the loudest interviewer somewhere, quietly.