IPDA: Intelligent Perception Delay Alignment Method Based on Spatio-Temporal Co-Sensing Calibration
Jianhang Liu, Dianzheng Zhang, Hongxin Pan, Guangqian Jiang, Runda Fan
摘要
Intelligent perception among multiple agents enables them to extend their individual observation capabilities by sharing sensory information, thereby improving the completeness and accuracy of environmental understanding. However, real-world communication is often subject to non-negligible delays, which can degrade the effectiveness of perception. To mitigate this, delay alignment is commonly employed to synchronize delayed observations to a common timestamp. Yet, both alignment errors and inherent discrepancies between multi-view observations can lead to inconsistencies in the estimated position and orientation of shared targets. These inconsistencies can accumulate during feature fusion, ultimately reducing the accuracy and reliability of the perception results.To address this challenge, we propose IPDA, a delay-aware multi-agent intelligent perception method that performs joint calibration in both temporal and spatial domains. In the temporal dimension, we design a historical alignment attention mechanism to model dynamic delay correction across sequences, ensuring temporal coherence. In the spatial dimension, we introduce a discrepancy-quantized co-sensing network that captures and compensates for multi-view spatial deviations caused by viewpoint diversity and alignment inaccuracy. IPDA is evaluated on two large-scale intelligent perception benchmarks, DAIR-V2X and OPV2V. Experimental results demonstrate that our method effectively mitigates delay-induced inconsistencies and consistently outperforms state-of-the-art baselines under various delay conditions.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence MapsYue Hu, Shaoheng Fang, Zixing Lei, Yiqi Zhong 等NeurIPS 2022 · 被引用 537 次
- DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object DetectionHaibao Yu, Yizhen Luo, Mao Shu, Yiyi Huo 等CVPR 2022 · 被引用 475 次
- An Extensible Framework for Open Heterogeneous Collaborative PerceptionYifan Lu, Yue Hu, Yiqi Zhong, Dequan Wang 等ICLR 2024 · 被引用 116 次
- Asynchrony-Robust Collaborative Perception via Bird's Eye View FlowSizhe Wei, Yuxi Wei, Yue Hu, Yifan Lu 等NeurIPS 2023 · 被引用 102 次
- Spatio-Temporal Domain Awareness for Multi-Agent Collaborative PerceptionKun Yang, Dingkang Yang, Jingyu Zhang, Mingcheng Li 等ICCV 2023 · 被引用 99 次
相关 Paper
- STCC: A Spatio-Temporal Calibration Method for Delay-Tolerant Cooperative Vehicular NetworkJianhang Liu, Hongxin Pan, Tingpei Huang, Xuerong Cui 等INFOCOM 2026
- TraF-Align: Trajectory-aware Feature Alignment for Asynchronous Multi-agent PerceptionZhiying Song, Lei Yang, Fuxi Wen, Jun LiCVPR 2025
- BEVSync: Asynchronous Data Alignment for Camera-based Vehicle-Infrastructure Cooperative Perception Under Uncertain DelaysWentao Wang, Jiaqian Wang, Yuxin Deng, Guang TanAAAI 2025 · 被引用 2 次
- FeaCo: Reaching Robust Feature-Level Consensus in Noisy Pose ConditionsJiaming Gu, Jingyu Zhang, Muyang Zhang, Weiliang Meng 等ACM MM 2023 · 被引用 21 次
- Pragmatic Heterogeneous Collaborative Perception via Generative Communication MechanismJunfei Zhou, Penglin Dai, Quanmin Wei, Bingyi Liu 等NeurIPS 2025 · 被引用 11 次
