WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaboration
Gong Chen, Chaokun Zhang, Xinyan Zhao
摘要
Collaborative perception is vital for autonomous driving yet remains constrained by tight communication budgets. Earlier work reduced bandwidth by compressing full feature maps with fixed-rate encoders, which adapts poorly to a changing environment, and it further evolved into spatial selection methods that improve efficiency by focusing on salient regions, but this object-centric approach often sacrifices global context, weakening holistic scene understanding. To overcome these limitations, we introduce WhisperNet, a bandwidth-aware framework that proposes a novel, receiver-centric paradigm for global coordination across agents. Senders generate lightweight saliency metadata, while the receiver formulates a global request plan that dynamically budgets feature contributions across agents and features, retrieving only the most informative features. A collaborative feature routing module then aligns related messages before fusion to ensure structural consistency. Extensive experiments show that WhisperNet achieves state-of-the-art performance, improving AP@0.7 on OPV2V by 2.4% with only 0.5% of the communication cost. As a plug-and-play component, it boosts strong baselines with merely 5% of full bandwidth while maintaining robustness under localization noise. These results demonstrate that globally-coordinated allocation across what and where to share is the key to achieving efficient collaborative perception.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence MapsYue Hu, Shaoheng Fang, Zixing Lei, Yiqi Zhong 等NeurIPS 2022 · 被引用 537 次
- DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object DetectionHaibao Yu, Yizhen Luo, Mao Shu, Yiyi Huo 等CVPR 2022 · 被引用 475 次
- How2comm: Communication-Efficient and Collaboration-Pragmatic Multi-Agent PerceptionDingkang Yang, Kun Yang, Yuzheng Wang, Jing Liu 等NeurIPS 2023 · 被引用 160 次
- HS-FPN: High Frequency and Spatial Perception FPN for Tiny Object DetectionZican Shi, Jing Hu, Jie Ren, Hengkang Ye 等AAAI 2025 · 被引用 85 次
- Core: Cooperative Reconstruction for Multi-Agent PerceptionBinglu Wang, Lei Zhang, Zhaozhong Wang, Yongqiang Zhao 等ICCV 2023 · 被引用 73 次
相关 Paper
- What2comm: Towards Communication-efficient Collaborative Perception via Feature DecouplingKun Yang, Dingkang Yang, Jingyu Zhang, Hanqi Wang 等ACM MM 2023 · 被引用 58 次
- Communication-Efficient Collaborative Perception via Information Filling with CodebookYue Hu, Juntong Peng, Sifei Liu, Junhao Ge 等CVPR 2024
- ZeRCP: Towards Communication-Efficient Collaborative Perception and Future Scene Prediction via Request-Free Spatial FilteringYijie Chen, Yuzhe Ji, Haotian Wang, Xiaoyun Qiu 等AAAI 2026
- INSTINCT: Instance-Level Interaction Architecture for Query-Based Collaborative PerceptionYunjiang Xu, Lingzhi Li, Jin Wang, Yupeng Ouyang 等ICCV 2025 · 被引用 5 次
- InfoCom: Kilobyte-Scale Communication-Efficient Collaborative Perception with Information BottleneckQuanmin Wei, Penglin Dai, Wei Li, Bingyi Liu 等AAAI 2026 · 被引用 3 次
