Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation
Shiyuan Li, Yixin Liu, Qingsong Wen, Chengqi Zhang, Shirui Pan
Abstract
Multi-agent systems (MAS) based on large language models (LLMs) have emerged as a powerful solution for dealing with complex problems across diverse domains. The effectiveness of MAS is critically dependent on its collaboration topology, which has become a focal point for automated design research. However, existing approaches are fundamentally constrained by their reliance on a template graph modification paradigm with a predefined set of agents and hard-coded interaction structures, significantly limiting their adaptability to task-specific requirements. To address these limitations, we reframe MAS design as a conditional autoregressive graph generation task, where both the system composition and structure are designed jointly. We propose ARG-Designer, a novel autoregressive model that operationalizes this paradigm by constructing the collaboration graph from scratch. Conditioned on a natural language task query, ARG-Designer sequentially and dynamically determines the required number of agents, selects their appropriate roles from an extensible pool, and establishes the optimal communication links between them. This generative approach creates a customized topology in a flexible and extensible manner, precisely tailored to the unique demands of different tasks. Extensive experiments across six diverse benchmarks demonstrate that ARG-Designer not only achieves state-of-the-art performance but also enjoys significantly greater token efficiency and enhanced extensibility.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6d62da47-57e3-4f11-9eed-7b7ef09f6c53Cited by top-tier papers18
- BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown AttacksRui Miao, Yixin Liu, Yili Wang, Xu Shen et al.ACL 2026 · 34 citations
- Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent SystemsFulin Lin, Shaowen Chen, Ruishan Fang, Hongwei Wang et al.ICLR 2026 · 15 citations
- Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly DetectionJunjun Pan, Yixin Liu, Rui Miao, Kaize Ding et al.ACL 2026 · 6 citations
- Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test TimeJunjun Pan, Yixin Liu, Chuan Zhou, Fei Xiong et al.AAAI 2026 · 5 citations
- Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent SystemsXu Shen, Yixin Liu, Yiwei Dai, Yili Wang et al.EMNLP 2025 · 4 citations
Builds on25
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Measuring Massive Multitask Language UnderstandingDan Hendrycks, Collin Burns, Steven Basart, Andy Zou et al.ICLR 2021 · 7,905 citations
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
- MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained TransformersWenhui Wang, Furu Wei, Li Dong, Hangbo Bao et al.NeurIPS 2020 · 2,727 citations
- Improving Factuality and Reasoning in Language Models through Multiagent DebateYilun Du, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum et al.ICML 2024 · 1,562 citations
Related papers
- Hetero-Designer: Automated Design of Multi-Agent Systems with Heterogeneous LLMsZhiheng Zhang, Yuanzhe Zhang, Bohan Yu, Daojian Zeng et al.ACL 2026
- AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code GenerationSiyu Wang, Ruotian Lu, Zhihao Yang, Yuchao Wang et al.ICML 2026 · 8 citations
- Dynamic Generation of Multi LLM Agents Communication Topologies with Graph Diffusion ModelsEric Hanchen Jiang, Levina Li, Frank Wan, Xiao Liang et al.ACL 2026 · 6 citations
- Multi-Agent Design: Optimizing Agents with Better Prompts and TopologiesHan Zhou, Xingchen Wan, Ruoxi Sun, Hamid Palangi et al.ICLR 2026 · 127 citations
- G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural NetworksGuibin Zhang, Yanwei Yue, Xiangguo Sun, Guancheng Wan et al.ICML 2025
