Modeling Continuous Motion for 3D Point Cloud Object Tracking
Zhipeng Luo, Gongjie Zhang, Changqing Zhou, Zhonghua Wu, Qingyi Tao, Lewei Lu, Shijian Lu
Abstract
The task of 3D single object tracking (SOT) with LiDAR point clouds is crucial for various applications, such as autonomous driving and robotics. However, existing approaches have primarily relied on appearance matching or motion modeling within only two successive frames, thereby overlooking the long-range continuous motion property of objects in 3D space. To address this issue, this paper presents a novel approach that views each tracklet as a continuous stream: at each timestamp, only the current frame is fed into the network to interact with multi-frame historical features stored in a memory bank, enabling efficient exploitation of sequential information. To achieve effective cross-frame message passing, a hybrid attention mechanism is designed to account for both long-range relation modeling and local geometric feature extraction. Furthermore, to enhance the utilization of multi-frame features for robust tracking, a contrastive sequence enhancement strategy is proposed, which uses ground truth tracklets to augment training sequences and promote discrimination against false positives in a contrastive manner. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art method by significant margins on multiple benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 126c360b-dd39-4b6e-a821-a7ef99b0ccbfCited by top-tier papers4
- Viewpoint-Aware Visual Grounding in 3D ScenesXiangxi Shi, Zhonghua Wu, Stefan LeeCVPR 2024 · 13 citations
- TrackAny3D: Transferring Pretrained 3D Models for Category-Unified 3D Point Cloud TrackingMengmeng Wang, Haonan Wang, Yulong Li, Xiangjie Kong et al.ICCV 2025 · 2 citations
- Towards Scalable Spatial Intelligence Via 2D-To-3D Data LiftingXingyu Miao, Haoran Duan, Quanhao Qian, Jiuniu Wang et al.ICCV 2025 · 1 citation
- Generalizable Structure-Aware Keypoint Correspondence for Category-Unified 3D Single Object TrackingJie Xiao, Yinchao Ma, Yuyang Tang, Dengqing Yang et al.CVPR 2026
Builds on23
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- Data-Efficient Image Recognition with Contrastive Predictive CodingOlivier J. HénaffICML 2020 · 1,553 citations
Related papers
- VoxelTrack: Exploring Multi-level Voxel Representation for 3D Point Cloud Object TrackingYuxuan Lu, Jiahao Nie, Zhiwei He, Hongjie Gu et al.ACM MM 2024 · 4 citations
- MGTANet: Encoding Sequential LiDAR Points Using Long Short-Term Motion-Guided Temporal Attention for 3D Object DetectionJunho Koh, Junhyung Lee, Youngwoo Lee, Jaekyum Kim et al.AAAI 2023 · 34 citations
- Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point CloudsChaoda Zheng, Xu Yan, Haiming Zhang, Baoyuan Wang et al.CVPR 2022 · 100 citations
- M3SOT: Multi-Frame, Multi-Field, Multi-Space 3D Single Object TrackingJiaming Liu, Yue Wu, Maoguo Gong, Qiguang Miao et al.AAAI 2024 · 17 citations
- CompTrack: Information Bottleneck-Guided Low-Rank Dynamic Token Compression for Point Cloud TrackingSifan Zhou, Yichao Cao, Jiahao Nie, Yuqian Fu et al.AAAI 2026 · 9 citations
