Ask Less, See More: Communication-Conditioned Token Pruning for Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models
Shiqi Sun, Yantao Lu, Bingkun Sun, Ning Liu, Bo Jiang, Ying Zhang, Jinchao Chen, Chenglie Du
摘要
Multimodal Large Language Models (MLLMs) offer a promising paradigm for vehicle-to-vehicle (V2V) cooperative autonomous driving, enabling language-based decision-making in safety-critical occluded scenarios. However, existing V2V–MLLM frameworks rely on dense token-level sharing and fusion, incurring high communication and inference costs. Moreover, conventional V2V perception methods are limited to feature-sharing paradigms without language reasoning, and existing token pruning strategies fail to consider LiDAR-specific spatial structure and multi-agent fusion. To address these limitations, we propose V2V Communication-Conditioned MLLM Framework (V2V-CCM), a dual-stage cooperative communication framework that broadcasts request messages to all agents and uses them to identify redundant visual tokens. Specifically, Question Semantic Message (QSM) encodes global question intent for question-relevant token selection, while Spatial Coverage Message (SCM) summarizes LiDAR features to identify spatially redundant tokens already observed by other agents. Integrated into dual-stage frameworks, V2V-CCM substantially reduces communication and inference costs while preserving question-relevant tokens and removing spatial redundancy. Extensive experiments on V2V-QA and V2V-GoT-QA demonstrate that V2V-CCM consistently outperforms existing pruning methods and achieves state-of-the-art performance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence MapsYue Hu, Shaoheng Fang, Zixing Lei, Yiqi Zhong 等NeurIPS 2022 · 被引用 537 次
- DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object DetectionHaibao Yu, Yizhen Luo, Mao Shu, Yiyi Huo 等CVPR 2022 · 被引用 475 次
- Learning Distilled Collaboration Graph for Multi-Agent PerceptionYiming Li, Shunli Ren, Pengxiang Wu, Siheng Chen 等NeurIPS 2021 · 被引用 464 次
- A-ViT: Adaptive Tokens for Efficient Vision TransformerHongxu Yin, Arash Vahdat, José M. Álvarez, Arun Mallya 等CVPR 2022 · 被引用 288 次
相关 Paper
- VLDrive: Vision-Augmented Lightweight MLLMs for Efficient Language-Grounded Autonomous DrivingRuifei Zhang, Wei Zhang, Xiao Tan, Sibei Yang 等ICCV 2025 · 被引用 2 次
- Prune2Drive: A Plug-and-Play Framework for Accelerating Vision-Language Models in Autonomous DrivingMinhao Xiong, Zichen Wen, Zhuangcheng Gu, Xuyang Liu 等CVPR 2026 · 被引用 17 次
- FastDriveVLA: Efficient End-to-End Driving via Plug-and-Play Reconstruction-based Token PruningJiajun Cao, Qizhe Zhang, Peidong Jia, Xuhui Zhao 等AAAI 2026 · 被引用 18 次
- METEOR: Multi-Encoder Collaborative Token Pruning for Efficient Vision Language ModelsYuchen Liu, Yaoming Wang, Bowen Shi, Xiaopeng Zhang 等ICCV 2025 · 被引用 2 次
- DCP: Dual-Cue Pruning for Efficient Large Vision-Language ModelsLei Jiang, Zixun Zhang, Yuting Zeng, Chunzhao Xie 等EMNLP 2025 · 被引用 2 次
