IPDA: Intelligent Perception Delay Alignment Method Based on Spatio-Temporal Co-Sensing Calibration
Jianhang Liu, Dianzheng Zhang, Hongxin Pan, Guangqian Jiang, Runda Fan
Abstract
Intelligent perception among multiple agents enables them to extend their individual observation capabilities by sharing sensory information, thereby improving the completeness and accuracy of environmental understanding. However, real-world communication is often subject to non-negligible delays, which can degrade the effectiveness of perception. To mitigate this, delay alignment is commonly employed to synchronize delayed observations to a common timestamp. Yet, both alignment errors and inherent discrepancies between multi-view observations can lead to inconsistencies in the estimated position and orientation of shared targets. These inconsistencies can accumulate during feature fusion, ultimately reducing the accuracy and reliability of the perception results.To address this challenge, we propose IPDA, a delay-aware multi-agent intelligent perception method that performs joint calibration in both temporal and spatial domains. In the temporal dimension, we design a historical alignment attention mechanism to model dynamic delay correction across sequences, ensuring temporal coherence. In the spatial dimension, we introduce a discrepancy-quantized co-sensing network that captures and compensates for multi-view spatial deviations caused by viewpoint diversity and alignment inaccuracy. IPDA is evaluated on two large-scale intelligent perception benchmarks, DAIR-V2X and OPV2V. Experimental results demonstrate that our method effectively mitigates delay-induced inconsistencies and consistently outperforms state-of-the-art baselines under various delay conditions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 498c9cd7-8ede-4c0e-b4ac-dd69734069a5Builds on16
- Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence MapsYue Hu, Shaoheng Fang, Zixing Lei, Yiqi Zhong et al.NeurIPS 2022 · 537 citations
- DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object DetectionHaibao Yu, Yizhen Luo, Mao Shu, Yiyi Huo et al.CVPR 2022 · 475 citations
- An Extensible Framework for Open Heterogeneous Collaborative PerceptionYifan Lu, Yue Hu, Yiqi Zhong, Dequan Wang et al.ICLR 2024 · 116 citations
- Asynchrony-Robust Collaborative Perception via Bird's Eye View FlowSizhe Wei, Yuxi Wei, Yue Hu, Yifan Lu et al.NeurIPS 2023 · 102 citations
- Spatio-Temporal Domain Awareness for Multi-Agent Collaborative PerceptionKun Yang, Dingkang Yang, Jingyu Zhang, Mingcheng Li et al.ICCV 2023 · 99 citations
Related papers
- STCC: A Spatio-Temporal Calibration Method for Delay-Tolerant Cooperative Vehicular NetworkJianhang Liu, Hongxin Pan, Tingpei Huang, Xuerong Cui et al.INFOCOM 2026
- TraF-Align: Trajectory-aware Feature Alignment for Asynchronous Multi-agent PerceptionZhiying Song, Lei Yang, Fuxi Wen, Jun LiCVPR 2025
- BEVSync: Asynchronous Data Alignment for Camera-based Vehicle-Infrastructure Cooperative Perception Under Uncertain DelaysWentao Wang, Jiaqian Wang, Yuxin Deng, Guang TanAAAI 2025 · 2 citations
- FeaCo: Reaching Robust Feature-Level Consensus in Noisy Pose ConditionsJiaming Gu, Jingyu Zhang, Muyang Zhang, Weiliang Meng et al.ACM MM 2023 · 21 citations
- Pragmatic Heterogeneous Collaborative Perception via Generative Communication MechanismJunfei Zhou, Penglin Dai, Quanmin Wei, Bingyi Liu et al.NeurIPS 2025 · 11 citations
