Weakly Supervised Visible-Infrared Person Re-Identification via Heterogeneous Expert Collaborative Consistency Learning
Yafei Zhang, Lingqi Kong, Huafeng Li, Jie Wen
Abstract
To reduce the reliance of visible-infrared person reidentification (ReID) models on labeled cross-modal samples, this paper explores a weakly supervised cross-modal person ReID method that uses only single-modal sample identity labels, addressing scenarios where cross-modal identity labels are unavailable. To mitigate the impact of missing cross-modal labels on model performance, we propose a heterogeneous expert collaborative consistency learning framework, designed to establish robust crossmodal identity correspondences in a weakly supervised manner. This framework leverages labeled data from each modality to independently train dedicated classification experts. To associate cross-modal samples, these classification experts act as heterogeneous predictors, predicting the identities of samples from the other modality. To improve prediction accuracy, we design a cross-modal relationship fusion mechanism that effectively integrates predictions from different experts. Under the implicit supervision provided by cross-modal identity correspondences, collaborative and consistent learning among the experts is encouraged, significantly enhancing the model's ability to extract modality-invariant features and improve crossmodal identity recognition. Experimental results on two challenging datasets validate the effectiveness of the proposed method. Code is available at https://github. com/KongLingqi2333/WSL-VIReID.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on24
- Infrared-Visible Cross-Modal Person Re-Identification with an X ModalityDiangang Li, Xing Wei, Xiaopeng Hong, Yihong GongAAAI 2020 · 419 citations
- Channel Augmented Joint Learning for Visible-Infrared RecognitionMang Ye, Weijian Ruan, Bo Du, Mike Zheng ShouICCV 2021 · 310 citations
- FMCNet: Feature-Level Modality Compensation for Visible-Infrared Person Re-IdentificationQiang Zhang, Changzhou Lai, Jianan Liu, Nianchang Huang et al.CVPR 2022 · 257 citations
- Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal CorrespondencesHyunjong Park, Sanghoon Lee, Junghyup Lee, Bumsub HamICCV 2021 · 248 citations
- Learning Memory-Augmented Unidirectional Metrics for Cross-modality Person Re-identificationJialun Liu, Yifan Sun, Feng Zhu, Hongbin Pei et al.CVPR 2022 · 196 citations
Related papers
- Unsupervised Visible-Infrared Person Re-Identification Under Unpaired SettingsHaoyu Yao, Bin Yang, Wenke Huang, Bo Du et al.ICCV 2025 · 1 citation
- Enhancing Unsupervised Visible-Infrared Person Re-Identification with Bidirectional-Consistency Gradual MatchingXiao Teng, Xingyu Shen, Kele Xu, Long LanACM MM 2024 · 16 citations
- Syncretic Modality Collaborative Learning for Visible Infrared Person Re-IdentificationZiyu Wei, Xi Yang, Nannan Wang, Xinbo GaoICCV 2021 · 173 citations
- Shallow-Deep Collaborative Learning for Unsupervised Visible-Infrared Person Re-IdentificationBin Yang, Jun Chen, Mang YeCVPR 2024 · 52 citations
- Semi-supervised Visible-Infrared Person Re-identification via Modality Unification and Confidence GuidanceXiying Zheng, Yukang Zhang, Yang Lu, Hanzi WangACM MM 2024 · 3 citations
