One is Plenty: A Polymorphic Feature Interpreter for Immutable Heterogeneous Collaborative Perception
Yuchen Xia, Quan Yuan, Guiyang Luo, Xiaoyuan Fu, Yang Li, Xuanhan Zhu, Tianyou Luo, Siheng Chen, Jinglin Li
Abstract
Collaborative perception in autonomous driving significantly enhances the perception capabilities of individual agents. Immutable heterogeneity, where agents have different and fixed perception networks, presents a major challenge due to the semantic gap in exchanged intermediate features without modifying the perception networks. Most existing methods bridge the semantic gap through interpreters. However, they either require training a new interpreter for each new agent type, limiting extensibility, or rely on a two-stage interpretation via an intermediate standardized semantic space, causing cumulative semantic loss. To achieve both extensibility in immutable heterogeneous scenarios and low-loss feature interpretation, we propose PolyInter, a polymorphic feature interpreter. It provides an extension point where new agents integrate by overriding only their specific prompts, which are learnable parameters that guide interpretation, while reusing PolyInter's remaining parameters. By leveraging polymorphism, our design enables a single interpreter to accommodate diverse agents and interpret their features into the ego agent's semantic space. Experiments on the OPV2V dataset demonstrate that PolyInter improves collaborative perception precision by up to 11.1% compared to SOTA interpreters, while comparable results can be achieved by training only 1.4% of PolyInter's parameters when adapting to new agents. Code is available at https://github.com/yuchen-xia/PolyInter .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7a920669-cd28-4bd0-bbd2-9c095063fb38Cited by top-tier papers6
- NegoCollab: A Common Representation Negotiation Approach for Heterogeneous Collaborative PerceptionCongzhang Shao, Quan Yuan, Guiyang Luo, Yue Hu et al.NeurIPS 2025 · 7 citations
- Linking Modality Isolation in Heterogeneous Collaborative PerceptionChangxing Liu, Zichen Chao, Siheng ChenCVPR 2026 · 3 citations
- TurboTrain: Towards Efficient and Balanced Multi-Task Learning for Multi-Agent Perception and PredictionZewei Zhou, Seth Z. Zhao, Tianhui Cai, Zhiyu Huang et al.ICCV 2025 · 2 citations
- X-MoGe: A Cross-Modal Adaptation Framework with Mixture-of-Experts and Geometry Guidance for Heterogeneous Collaborative PerceptionWenkai Lin, Zhihong Liu, Chenglu WenICML 2026
- CoLC: Communication-Efficient Collaborative Perception with LiDAR CompletionYushan Han, Hui Zhang, Qiming Xia, Yi Jin et al.CVPR 2026
Builds on18
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence MapsYue Hu, Shaoheng Fang, Zixing Lei, Yiqi Zhong et al.NeurIPS 2022 · 537 citations
- DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object DetectionHaibao Yu, Yizhen Luo, Mao Shu, Yiyi Huo et al.CVPR 2022 · 475 citations
- Decorate the Newcomers: Visual Domain Prompt for Continual Test Time AdaptationYulu Gan, Yan Bai, Yihang Lou, Xianzheng Ma et al.AAAI 2023 · 145 citations
- An Extensible Framework for Open Heterogeneous Collaborative PerceptionYifan Lu, Yue Hu, Yiqi Zhong, Dequan Wang et al.ICLR 2024 · 116 citations
Related papers
- You Share Beliefs, I Adapt: Progressive Heterogeneous Collaborative PerceptionHao Si, Ehsan Javanmardi, Manabu TsukadaICCV 2025 · 1 citation
- GT-Space: Enhancing Heterogeneous Collaborative Perception with Ground Truth Feature SpaceWentao Wang, Haoran Xu, Guang TanICLR 2026 · 2 citations
- HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative Perception with Vision TransformerHao Xiang, Runsheng Xu, Jiaqi MaICCV 2023 · 106 citations
- Pragmatic Heterogeneous Collaborative Perception via Generative Communication MechanismJunfei Zhou, Penglin Dai, Quanmin Wei, Bingyi Liu et al.NeurIPS 2025 · 11 citations
- One Model to Translate Them All: Universal Any-to-Any Translation for Heterogeneous Collaborative PerceptionYang Li, Weize Li, Quan Yuan, Shao Congzhang et al.ICML 2026
