Graph Sampling Based Deep Metric Learning for Generalizable Person Re-Identification
Shengcai Liao, Ling Shao
Abstract
Recent studies show that, both explicit deep feature matching as well as large-scale and diverse training data can significantly improve the generalization of person reidentification. However, the efficiency of learning deep matchers on large-scale data has not yet been adequately studied. Though learning with classification parameters or class memory is a popular way, it incurs large memory and computational costs. In contrast, pairwise deep metric learning within mini batches would be a better choice. However, the most popular random sampling method, the well-known PK sampler, is not informative and efficient for deep metric learning. Though online hard example mining has improved the learning efficiency to some extent, the mining in mini batches after random sampling is still limited. This inspires us to explore the use of hard example mining earlier, in the data sampling stage. To do so, in this paper, we propose an efficient mini-batch sampling method, called graph sampling (GS), for large-scale deep metric learning. The basic idea is to build a nearest neighbor relationship graph for all classes at the beginning of each epoch. Then, each mini batch is composed of a randomly selected class and its nearest neighboring classes so as to provide informative and challenging examples for learning. Together with an adapted competitive baseline, we improve the state of the art in generalizable person re-identification significantly, by 25.1% in Rank-1 on MSMT17 when trained on RandPerson. Besides, the proposed method also outperforms the competitive baseline, by 6.8% in Rank-1 on CUHK03-NP when trained on MSMT17. Meanwhile, the training time is significantly reduced, from 25.4 hours to 2 hours when trained on RandPerson with 8,000 identities. Code is available at https://github.com/ShengcaiLiao/QAConv .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 65d0446b-b76b-4ca9-9fc9-ef3b6b69770aCited by top-tier papers14
- Part-Aware Transformer for Generalizable Person Re-identificationHao Ni, Yuke Li, Lianli Gao, Heng Tao Shen et al.ICCV 2023 · 87 citations
- TransMatcher: Deep Image Matching Through Transformers for Generalizable Person Re-identificationShengcai Liao, Ling ShaoNeurIPS 2021 · 82 citations
- Modality Unifying Network for Visible-Infrared Person Re-IdentificationHao Yu, Xu Cheng, Wei Peng, Weihao Liu et al.ICCV 2023 · 75 citations
- Cloning Outfits from Real-World Images to 3D Characters for Generalizable Person Re-IdentificationYanan Wang, Xuezhi Liang, Shengcai LiaoCVPR 2022 · 35 citations
- PAED: Zero-Shot Persona Attribute Extraction in DialoguesLuyao Zhu, Wei Li, Rui Mao, Vlad Pandelea et al.ACL 2023 · 30 citations
Builds on9
- Omni-Scale Feature Learning for Person Re-IdentificationKaiyang Zhou, Yongxin Yang, Andrea Cavallaro, Tao XiangICCV 2019 · 997 citations
- Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-IDYixiao Ge, Feng Zhu, Dapeng Chen, Rui Zhao et al.NeurIPS 2020 · 688 citations
- Surpassing Real-World Source Training Data: Random 3D Characters for Generalizable Person Re-IdentificationYanan Wang, Shengcai Liao, Ling ShaoACM MM 2020 · 90 citations
- TransMatcher: Deep Image Matching Through Transformers for Generalizable Person Re-identificationShengcai Liao, Ling ShaoNeurIPS 2021 · 82 citations
- Learning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-IdentificationYuyang Zhao, Zhun Zhong, Fengxiang Yang, Zhiming Luo et al.CVPR 2021
Related papers
- MVP Matching: A Maximum-Value Perfect Matching for Mining Hard Samples, With Application to Person Re-IdentificationHan Sun, Zhiyuan Chen, Shiyang Yan, Lin XuICCV 2019 · 42 citations
- Fewer is More: A Deep Graph Metric Learning Perspective Using Fewer ProxiesYuehua Zhu, Muli Yang, Cheng Deng, Wei LiuNeurIPS 2020 · 67 citations
- Style-Controllable Generalized Person Re-identificationYuke Li, Jingkuan Song, Hao Ni, Heng Tao ShenACM MM 2023 · 24 citations
- Global Selection of Contrastive Batches via Optimization on Sample PermutationsVin Sachidananda, Ziyi Yang, Chenguang ZhuICML 2023 · 6 citations
- Deep Meta Metric LearningGuangyi Chen, Tianren Zhang, Jiwen Lu, Jie ZhouICCV 2019 · 65 citations
