Learning Multi-Agent Coordination via Sheaf-ADMM
Jeffrey Seely, Bartłomiej Cupiał, Llion Jones
Abstract
We present a differentiable optimization framework for multi-agent coordination. An input is decomposed into overlapping local views, each processed by an agent that solves a convex subproblem parameterized by a neural encoder. Agents coordinate through the Alternating Direction Method of Multipliers (ADMM) with inter-agent constraints specified by a cellular sheaf. The sheaf specifies which aspects of neighboring solutions must agree, allowing for heterogeneous notions of global consensus. Backpropagating through the unrolled optimization jointly trains all components of the multi-agent system. We evaluate on maze pathfinding, image classification, and Sudoku, where agents with individually insufficient local views learn to coordinate to produce correct global outputs. On MNIST, the local-view decomposition yields improved robustness to distribution shifts relative to a standard CNN. On Sudoku, the optimization-derived structure yields markedly higher solve rates than parameter-matched MPNN baselines. Finally, the ADMM structure exposes distinct primal, consensus, and dual state variables, opening the coordination dynamics to direct analysis and intervention—a property unavailable in standard message-passing architectures.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNsCristian Bodnar, Francesco Di Giovanni, Benjamin Paul Chamberlain, Pietro Lió et al.NeurIPS 2022 · 313 citations
- On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph LearningAlvaro Arroyo, Alessio Gravina, Benjamin Gutteridge, Federico Barbero et al.NeurIPS 2025 · 58 citations
- Cooperative Sheaf Neural NetworksAndré Ribeiro, Ana Luiza Tenorio, Juan Belieni, Amauri H Souza et al.ICLR 2026 · 13 citations
- Sheaves Reloaded: A Direction AwakeningStefano Fiorini, Hakan Emre Aktas, Iulia Duta, Pietro Morerio et al.ICLR 2026
- Deep Distributed Optimization for Large-Scale Quadratic ProgrammingAugustinos D. Saravanos, Hunter Kuperman, Alex Oshin, Arshiya Taj Abdul et al.ICLR 2025
Related papers
- Edge-consensus Learning: Deep Learning on P2P Networks with Nonhomogeneous DataKenta Niwa, Noboru Harada, Guoqiang Zhang, W. Bastiaan KleijnKDD 2020 · 34 citations
- Distributed Affine Body Dynamics with Adaptive ConsensusJiafeng Liu, Wenhui Zhou, Xinming Pei, Yifan Peng et al.SIGGRAPH 2026
- A Flexible Framework for Designing Trainable Priors with Adaptive Smoothing and Game EncodingBruno Lecouat, Jean Ponce, Julien MairalNeurIPS 2020 · 16 citations
- Expert-Inspired Multi-Agent Coordination for Multi-Objective Molecular OptimizationDaojian Zeng, Tianle Li, Jiahao Yang, Jiacai Yi et al.AAAI 2026
- Non-Linear Coordination GraphsYipeng Kang, Tonghan Wang, Qianlan Yang, Xiaoran Wu et al.NeurIPS 2022 · 14 citations
