Improving Multiple Pedestrian Tracking by Track Management and Occlusion Handling
Daniel Stadler, Jürgen Beyerer
Abstract
Multi-pedestrian trackers perform well when targets are clearly visible making the association task quite easy. However, when heavy occlusions are present, a mechanism to reidentify persons is needed. The common approach is to extract visual features from new detections and compare them with the features of previously found tracks. Since those detections can have substantial overlaps with nearby targetsespecially in crowded scenarios -the extracted features are insufficient for a reliable re-identification. In contrast, we propose a novel occlusion handling strategy that explicitly models the relation between occluding and occluded tracks outperforming the feature-based approach, while not depending on a separate re-identification network. Furthermore, we improve the track management of a regressionbased method in order to bypass missing detections and to deal with tracks leaving the scene at the border of the image. Finally, we apply our tracker in both temporal directions and merge tracklets belonging to the same target, which further enhances the performance. We demonstrate the effectiveness of our tracking components with ablative experiments and surpass the state-of-the-art methods on the three popular pedestrian tracking benchmarks MOT16, MOT17, and MOT20.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext deef13bf-fb3e-4e5c-a6b7-56ce2590c86aCited by top-tier papers11
- TrackFormer: Multi-Object Tracking with TransformersTim Meinhardt, Alexander Kirillov, Laura Leal-Taixé, Christoph FeichtenhoferCVPR 2022 · 927 citations
- Single-Model and Any-Modality for Video Object TrackingZongwei Wu, Jilai Zheng, Xiangxuan Ren, Florin-Alexandru Vasluianu et al.CVPR 2024 · 78 citations
- DeNoising-MOT: Towards Multiple Object Tracking with Severe OcclusionsTeng Fu, Xiaocong Wang, Haiyang Yu, Ke Niu et al.ACM MM 2023 · 11 citations
- APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate VideosTao Zhou, Wenhan Luo, Zhiguo Shi, Jiming Chen et al.ACM MM 2022 · 10 citations
- DINTR: Tracking via Diffusion-based InterpolationPha A. Nguyen, Ngan Le, Jackson David Cothren, Alper Yilmaz et al.NeurIPS 2024 · 5 citations
Builds on6
- Tracking Without Bells and WhistlesPhilipp Bergmann, Tim Meinhardt, Laura Leal-TaixéICCV 2019 · 1,030 citations
- Spatial-Temporal Relation Networks for Multi-Object TrackingJiarui Xu, Yue Cao, Zheng Zhang, Han HuICCV 2019 · 260 citations
- Lifted Disjoint Paths with Application in Multiple Object TrackingAndrea Hornáková, Roberto Henschel, Bodo Rosenhahn, Paul SwobodaICML 2020 · 131 citations
- TubeTK: Adopting Tubes to Track Multi-Object in a One-Step Training ModelBo Pang, Yizhuo Li, Yifan Zhang, Muchen Li et al.CVPR 2020
- How to Train Your Deep Multi-Object TrackerYihong Xu, Aljosa Osep, Yutong Ban, Radu Horaud et al.CVPR 2020
Related papers
- MotionTrack: Learning Robust Short-Term and Long-Term Motions for Multi-Object TrackingZheng Qin, Sanping Zhou, Le Wang, Jinghai Duan et al.CVPR 2023
- Probabilistic Tracklet Scoring and Inpainting for Multiple Object TrackingFatemeh Sadat Saleh, Sadegh Aliakbarian, Hamid Rezatofighi, Mathieu Salzmann et al.CVPR 2021
- Visio-Temporal Attention for Multi-Camera Multi-Target AssociationYu-Jhe Li, Xinshuo Weng, Yan Xu, Kris KitaniICCV 2021 · 16 citations
- Simple Cues Lead to a Strong Multi-Object TrackerJenny Seidenschwarz, Guillem Brasó, Victor Castro Serrano, Ismail Elezi et al.CVPR 2023
- SiamMOT: Siamese Multi-Object TrackingBing Shuai, Andrew G. Berneshawi, Xinyu Li, Davide Modolo et al.CVPR 2021
