Lune

ACL Findings2026

ConSensus: Multi-Agent Collaboration for Multimodal Sensing

Hyungjun Yoon, Mohammad Malekzadeh, Sung-Ju Lee, Fahim Kawsar, Lorena Qendro

Abstract

Large language models (LLMs) are increasingly grounded in sensor data to perceive and reason about human physiology and the physical world. However, accurately interpreting heterogeneous multimodal sensor data remains a fundamental challenge. We show that a single monolithic LLM often fails to reason coherently across modalities, leading to incomplete interpretations and prior-knowledge bias. We introduce ConSensus, a training-free multi-agent collaboration framework that decomposes multimodal sensing tasks into specialized, modality-aware agents. To aggregate agent-level interpretations, we propose a hybrid fusion mechanism that balances semantic aggregation, which enables cross-modal reasoning and contextual understanding, with statistical consensus, which provides robustness through agreement across modalities. While each approach has complementary failure modes, their combination enables reliable inference under sensor noise and missing data. We evaluate ConSensus on five diverse multimodal sensing benchmarks, demonstrating an average accuracy improvement of 7.1% over the single-agent baseline. Furthermore, ConSensus matches or exceeds the performance of iterative multi-agent debate methods while achieving a 12.7× reduction in average fusion token cost through a single-round hybrid fusion protocol, yielding a robust and efficient solution for realworld multimodal sensing tasks. The source code is available at https://github.com/n okia/multi-agent-collaboration-for-m ultimodal-sensing.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • Improving Factuality and Reasoning in Language Models through Multiagent Debate cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • Improving Factuality and Reasoning in Language Models through Multiagent Debate cites Self-Refine: Iterative Refinement with Self-Feedback
  • Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate cites Self-Refine: Iterative Refinement with Self-Feedback
  • Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate cites Improving Factuality and Reasoning in Language Models through Multiagent Debate
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on16

  1. Self-Refine: Iterative Refinement with Self-FeedbackAman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan et al.NeurIPS 2023 · 4,972 citations
  2. CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model SocietyGuohao Li, Hasan Hammoud, Hani Itani, Dmitrii Khizbullin et al.NeurIPS 2023 · 1,975 citations
  3. Improving Factuality and Reasoning in Language Models through Multiagent DebateYilun Du, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum et al.ICML 2024 · 1,562 citations
  4. Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
  5. Encouraging Divergent Thinking in Large Language Models through Multi-Agent DebateTian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang et al.EMNLP 2024 · 177 citations

Related papers

  1. AgentSense: LLMs Empower Generalizable and Explainable Web-Based Participatory Urban SensingXusen Guo, Mingxing Peng, Xixuan Hao, Xingchen Zou et al.WWW 2026 · 2 citations
  2. InEx: Hallucination Mitigation via Introspection and Cross-Modal Multi-Agent CollaborationZhongyu Yang, Yingfang Yuan, Xuanming Jiang, Baoyi An et al.AAAI 2026 · 5 citations
  3. MedAgents: Large Language Models as Collaborators for Zero-shot Medical ReasoningXiangru Tang, Anni Zou, Zhuosheng Zhang, Ziming Li et al.ACL Findings 2024 · 160 citations
  4. MLZero: A Multi-Agent System for End-to-end Machine Learning AutomationHaoyang Fang, Boran Han, Nick Erickson, Xiyuan Zhang et al.NeurIPS 2025 · 29 citations
  5. Ensemble Learning for Heterogeneous Large Language Models with Deep Parallel CollaborationYichong Huang, Xiaocheng Feng, Baohang Li, Yang Xiang et al.NeurIPS 2024 · 94 citations
Dusk over the sea between two cliffs drawn in fine vertical lines