More Debate Talk May Reduce Argument Diversity
A new preprint isolates protocol effects from model effects in multi agent debate systems by matching prompts and decoding settings across protocols in macroeconomic forecasting tasks.
A new preprint isolates protocol effects from model effects in multi agent debate systems by matching prompts and decoding settings across protocols in macroeconomic forecasting tasks.
{"article_body": "Multi-agent debate systems are only as good as the protocol running them. A new preprint from Ramtin Zargari Marandi, published March 28, 2026 on arXiv, makes that case with a controlled study that isolates protocol effects from model effects \u2014 a distinction the existing literature routinely conflates.\n\nThe study compares three debate protocols against a no-interaction baseline, using matched prompts and decoding settings across 20 diverse macroeconomic events with five random seeds. The protocols: Within-Round (WR), where agents see only current-round contributions; Cross-Round (CR), where agents receive full prior-round context; and the novel Rank-Adaptive Cross-Round (RA-CR), which dynamically reorders agents each round and silences one per round via an external judge model.\n\nThe results reveal a trade-off that should inform how teams deploy multi-agent systems. RA-CR achieves faster convergence than CR. WR shows higher peer-referencing \u2014 agents explicitly engage with what their peers wrote. And the No-Interaction baseline maximized argument diversity, which was unaffected across the main protocols. The finding that argument diversity stays constant regardless of protocol is the one that should concern teams building always-on debate systems.\n\nThe core contribution is methodological as much as empirical. Previous multi-agent debate research held the protocol fixed while varying model-related factors, making it impossible to disentangle what the protocol contributed versus what the model contributed. This study matches prompts, decoding settings, and event inputs across protocols and isolates the protocol effect directly. The answer: protocol design matters, and it matters differently depending on what you are optimizing for.\n\nWhen consensus is the goal \u2014 the system needs to converge on a single answer \u2014 RA-CR outperforms. When diversity of argument is the goal \u2014 you want the system to explore the space rather than agree \u2014 the protocol choice matters less, and the no-interaction baseline is as good as the others. For teams building multi-agent systems, this suggests the right question is not which model to use but which protocol to invoke, and when.\n\nThe practical implication the paper lands on is conditional invocation: complexity-triggered policies that decide which protocol to use based on the task, rather than running always-on debate. An agentic workflow that needs a correct single answer should invoke RA-CR. One that needs broad exploration of a problem space should arguably give agents less peer visibility, not more.\n\nThis is a preprint \u2014 it has not been peer reviewed. The domain is macroeconomic forecasting using the Federal Reserve Economic Data (FRED) series CORESTICKM159SFRBATL maintained by the Federal Reserve Bank of St. Louis, which is a well-structured problem with verifiable ground truth. Whether the findings transfer to less structured domains, like legal reasoning or open-ended research, is not answered here. The judge model used is also not specified, which matters because RA-CR\u2019s performance depends heavily on what the judge is optimizing for.\n\nBut the methodological point stands: the multi-agent systems being deployed in production today are making protocol choices without controlled evidence for what those choices actually produce. The gap between \u201cwe run multi-agent debate\u201d as a design statement and \u201cwe chose RA-CR because the evidence says it converges faster for consensus tasks\u201d is exactly the kind of infrastructure-level thinking that separates systems that work in demos from systems that work in production.\n\nSource: arXiv:2603.28813 \u2014 Ramtin Zargari Marandi, March 28, 2026."}