AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration
Zhexuan Wang, Yutong Wang, Xuebo Liu, Liang Ding, Miao Zhang, Jie Liu, Min Zhang
Abstract
Multi-agent systems (MAS) based on large language models (LLMs) have demonstrated significant potential in collaborative problemsolving. However, they still face substantial challenges of low communication efficiency and suboptimal task performance, making the careful design of the agents' communication topologies particularly important. Inspired by the management theory that roles in an efficient team are often dynamically adjusted, we propose AgentDropout, which identifies redundant agents and communication across different communication rounds by optimizing the adjacency matrices of the communication graphs and eliminates them to enhance both token efficiency and task performance. Compared to state-of-the-art methods, AgentDropout achieves an average reduction of 21.6% in prompt token consumption and 18.4% in completion token consumption, along with a performance improvement of 1.14 on the tasks. Furthermore, the extended experiments demonstrate that AgentDropout achieves notable domain transferability and structure robustness, revealing its reliability and effectiveness. We release our code at https://github. com/wangzx1219/AgentDropout .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 407719f1-818a-4d8d-b9c6-e046d74e01b2Cited by top-tier papers13
- Thought Communication in Multiagent CollaborationYujia Zheng, Zhuokai Zhao, Zijian Li, Yaqi Xie et al.NeurIPS 2025 · 31 citations
- Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent SystemsFulin Lin, Shaowen Chen, Ruishan Fang, Hongwei Wang et al.ICLR 2026 · 15 citations
- AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code GenerationSiyu Wang, Ruotian Lu, Zhihao Yang, Yuchao Wang et al.ICML 2026 · 8 citations
- SafeSieve: From Heuristics to Experience in Progressive Pruning for LLM-based Multi-Agent CommunicationRuijia Zhang, Xinyan Zhao, Ruixiang Wang, Sigen Chen et al.AAAI 2026 · 4 citations
- REA-RL: Reflection-Aware Online Reinforcement Learning for Efficient ReasoningHexuan Deng, Wenxiang Jiao, Xuebo Liu, Jun Rao et al.ICLR 2026 · 4 citations
Builds on13
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Building Cooperative Embodied Agents Modularly with Large Language ModelsHongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou et al.ICLR 2024 · 303 citations
- Drawing Early-Bird Tickets: Toward More Efficient Training of Deep NetworksHaoran You, Chaojian Li, Pengfei Xu, Yonggan Fu et al.ICLR 2020 · 282 citations
- Encouraging Divergent Thinking in Large Language Models through Multi-Agent DebateTian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang et al.EMNLP 2024 · 177 citations
- DSPy: Compiling Declarative Language Model Calls into State-of-the-Art PipelinesOmar Khattab, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang et al.ICLR 2024 · 170 citations
Related papers
- Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent SystemsGuibin Zhang, Yanwei Yue, Zhixun Li, Sukwon Yun et al.ICLR 2025
- AgentTailor: A Semantic-Aware LLM-Based Multi-Agent System with Actor-Critic StructurePeiting Yang, Jiahao Shi, Caiyi Xu, Ming Liu et al.ICML 2026
- Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph GenerationShiyuan Li, Yixin Liu, Qingsong Wen, Chengqi Zhang et al.AAAI 2026 · 29 citations
- G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural NetworksGuibin Zhang, Yanwei Yue, Xiangguo Sun, Guancheng Wan et al.ICML 2025
- RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure GenerationZhen Zhang, Wanjing Zhou, Juncheng Li, Hao Fei et al.ICML 2026 · 2 citations
