Tracking through Severe Occlusion via Event-Derived Transient Cues
Hao Dong, Yujin Liu, Haoyue Liu, Zhenyu Wang, Shihan Peng, Zhiwei Shi, Yi Chang, Luxin Yan
摘要
Tracking targets with high-speed and nonlinear motion under occlusion remains challenging due to spatial appearance deprivation and temporal trajectory fragmentation caused by missing visual cues. Existing methods typically either dynamically update templates to maintain appearance similarity or employ autoregressive models to predict targets from historical trajectories. However, these methods are ineffective under severe occlusion owing to template contamination and limited frame rates for complex motion. In this work, we observe that occlusion inherently degrades the spatial matching mechanism, highlighting the importance of temporal cues. Meanwhile, event cameras with microsecond-level temporal resolution provide transient dynamic cues that facilitate modeling nonlinear motion. In light of this, we propose EvoTrack, an occlusion-robust tracking framework via event-derived transient evolution, which comprises event-based motion autoregression and target-aware appearance matching. Specifically, for motion autoregression, the fine-grained timestamps of events naturally encode the target's direction and speed, motivating a bidirectional motion consistency that constrains interframe displacement prediction under nonlinear motion. For appearance matching, we adopt a Gaussian masking strategy to simulate occlusion degradation, guiding the model to focus on target regions and learn invariant representations. Furthermore, we build a pixel-aligned Frame-Event tracking dataset with higher spatial resolution and explicit occlusion labels. Extensive experiments demonstrate the effectiveness of EvoTrack in challenging occlusion scenes.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper35
- MixFormer: End-to-End Tracking with Iterative Mixed AttentionYutao Cui, Cheng Jiang, Limin Wang, Gangshan WuCVPR 2022 · 被引用 746 次
- Spiking Transformers for Event-based Single Object TrackingJiqing Zhang, Bo Dong, Haiwei Zhang, Jianchuan Ding 等CVPR 2022 · 被引用 171 次
- Object Tracking by Jointly Exploiting Frame and Event DomainJiqing Zhang, Xin Yang, Yingkai Fu, Xiaopeng Wei 等ICCV 2021 · 被引用 141 次
- SMILEtrack: SiMIlarity LEarning for Occlusion-Aware Multiple Object TrackingYu-Hsiang Wang, Jun-Wei Hsieh, Ping-Yang Chen, Ming-Ching Chang 等AAAI 2024 · 被引用 96 次
- Single-Model and Any-Modality for Video Object TrackingZongwei Wu, Jilai Zheng, Xiangxuan Ren, Florin-Alexandru Vasluianu 等CVPR 2024 · 被引用 78 次
相关 Paper
- MATE: Motion-Augmented Temporal Consistency for Event-Based Point TrackingHan Han, Wei Zhai, Yang Cao, Bin Li 等ICCV 2025 · 被引用 3 次
- Event6D: Event-based Novel Object 6D Pose TrackingJae-Young Kang, Hoonhee Cho, Taeyeop Lee, Minjun Kang 等CVPR 2026 · 被引用 4 次
- TimeTracker: Event-based Continuous Point Tracking for Video Frame Interpolation with Non-linear MotionHaoyue Liu, Jinghan Xu, Yi Chang, Hanyu Zhou 等CVPR 2025
- Learning Visual Motion Segmentation Using Event SurfacesAnton Mitrokhin, Zhiyuan Hua, Cornelia Fermüller, Yiannis AloimonosCVPR 2020
- Event-Based Motion Deblurring Using Task-Oriented 3D Gaussian Event RepresentationsShengdong Xue, Haoxiang Ma, Hao Chen, Zhen Yang 等CVPR 2026
