Lune

EMNLP2024Top-tier venue

An Electoral Approach to Diversify LLM-based Multi-Agent Collective Decision-Making

Xiutian Zhao, Ke Wang, Wei Peng

Abstract

Modern large language models (LLMs) have exhibited cooperative synergy on complex tasksolving, and collective decision-making (CDM) is a pivotal component in LLM-based multiagent collaboration frameworks. Our survey on 52 recent such systems uncovers a severe lack of diversity, with a heavy reliance on dictatorial and plurality voting for CDM. Through the lens of social choice theory, we scrutinize widelyadopted CDM methods and identify their limitations. To enrich current landscape of LLMbased CDM, we present GEDI, an electoral CDM module that incorporates various ordinal preferential voting mechanisms. Our empirical case study across three benchmarks shows that the integration of certain CDM methods can markedly improve the reasoning capabilities and robustness of some leading LLMs, all without requiring intricate system designs. Additionally, we find that some CDM mechanisms generate positive synergies even with as few as three agents. The voting-based methods also demonstrate robustness against single points of failure, as well as diversity in terms of hitrate@k and subject-wise impacts. 1

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

3 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Generative Agents: Interactive Simulacra of Human Behavior cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • A Game-Theoretica Negotiation Framework for Cross-Cultural Consensus cites Improving Factuality and Reasoning in Language Models through Multiagent Debate
  • Reflexion: language agents with verbal reinforcement learning cites Generative Agents: Interactive Simulacra of Human Behavior
  • Reflexion: language agents with verbal reinforcement learning cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • AgentCDM: Enhancing Multi-Agent Collaborative Decision-Making via ACH-Inspired Structured Reasoning cites Measuring Massive Multitask Language Understanding
  • AgentCDM: Enhancing Multi-Agent Collaborative Decision-Making via ACH-Inspired Structured Reasoning cites Improving Factuality and Reasoning in Language Models through Multiagent Debate
  • Improving Factuality and Reasoning in Language Models through Multiagent Debate cites Measuring Massive Multitask Language Understanding
  • Improving Factuality and Reasoning in Language Models through Multiagent Debate cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers3

  1. AgentCDM: Enhancing Multi-Agent Collaborative Decision-Making via ACH-Inspired Structured ReasoningXuyang Zhao, Shiwan Zhao, Hualong Yu, Liting Zhang et al.AAAI 2026 · 3 citations
  2. Tackling Model Bias via Game-theoretic Multi-agent Collaboration Framework for Hateful Meme ClassificationYiwei Wei, Zhengliang Guo, Shaozu Yuan, Chengyin Hu et al.CVPR 2026
  3. A Game-Theoretica Negotiation Framework for Cross-Cultural ConsensusGuoxi Zhang, Jiawei Chen, Tianzhuo Yang, Jiaming Ji et al.ACL 2026

Builds on22

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  2. Measuring Massive Multitask Language UnderstandingDan Hendrycks, Collin Burns, Steven Basart, Andy Zou et al.ICLR 2021 · 7,905 citations
  3. Reflexion: language agents with verbal reinforcement learningNoah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan et al.NeurIPS 2023 · 5,828 citations
  4. Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris et al.UIST 2023 · 1,882 citations
  5. Improving Factuality and Reasoning in Language Models through Multiagent DebateYilun Du, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum et al.ICML 2024 · 1,562 citations

Related papers

  1. Multi-Agent Debate for LLM Judges with Adaptive Stability DetectionTianyu Hu, Zhen Tan, Song Wang, Huaizhi Qu et al.NeurIPS 2025 · 25 citations
  2. Probabilistic Aggregation and Targeted Embedding Optimization for Collective Moral Reasoning in Large Language ModelsChenchen Yuan, Zheyu Zhang, Shuo Yang, Bardh Prenkaj et al.ACL Findings 2025
  3. Ranked Voting based Self-Consistency of Large Language ModelsWeiqin Wang, Yile Wang, Hui HuangACL Findings 2025 · 4 citations
  4. Mitigating Judgment Preference Bias in Large Language Models through Group-Based PollingShuliang Liu, Zhipeng Xu, Zhenghao Liu, Yukun Yan et al.ACL Findings 2026
  5. MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-MakingYubin Kim, Chanwoo Park, Hyewon Jeong, Yik Siu Chan et al.NeurIPS 2024 · 291 citations
Dusk over the sea between two cliffs drawn in fine vertical lines