Low-light Invariant Representation Learning for Visible-Infrared Person Re-identification
Dengwen Wang, Guanyu Xing, Yanli Liu
摘要
Retrieving target pedestrians from cross-modal images captured by infrared and visible cameras is critical in 24-hour intelligent surveillance. The primary challenge lies in narrowing the modality gap between the visible and infrared modalities. In view of this, existing research tends to extract modality-shared features to bridge the modality gap. However, the extraction process and effectiveness of the shared features are often insufficiently justified. In contrast, we observe that a certain portion of semantics remains invariant across visible and infrared modalities. These invariant semantics provide the basis for extracting modality-shared features. Based on this criterion, we propose a novel method named Low-light Invariant Representation Learning (IRL), which aims to construct an invariant space shared between visible and infrared modalities. Specifically, we introduce a Modality Invariant Extractor, which divides invariance into modality invariance and scale invariance, and extracts the invariant features from different scales and dimensions respectively. Furthermore, a Low-light Representation Enhancement module is designed, which reuses the invariant features and shallow modality features through paired enhancement units and compensation units to highlight cross-modality shared features. Extensive experiments on SYSU-MM01, RegDB, and LLCM benchmarks demonstrate the effectiveness of our method. Code is available https://github.com/Mapzzone/IRL.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
引用它的顶会 Paper1
问问它们各自怎么用它相关 Paper
- Joint Color-irrelevant Consistency Learning and Identity-aware Modality Adaptation for Visible-infrared Cross Modality Person Re-identificationZhiwei Zhao, Bin Liu, Qi Chu, Yan Lu 等AAAI 2021 · 被引用 92 次
- Infrared-Visible Cross-Modal Person Re-Identification with an X ModalityDiangang Li, Xing Wei, Xiaopeng Hong, Yihong GongAAAI 2020 · 被引用 419 次
- Co-Attentive Lifting for Infrared-Visible Person Re-IdentificationXing Wei, Diangang Li, Xiaopeng Hong, Wei Ke 等ACM MM 2020 · 被引用 61 次
- Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal CorrespondencesHyunjong Park, Sanghoon Lee, Junghyup Lee, Bumsub HamICCV 2021 · 被引用 248 次
- Syncretic Modality Collaborative Learning for Visible Infrared Person Re-IdentificationZiyu Wei, Xi Yang, Nannan Wang, Xinbo GaoICCV 2021 · 被引用 173 次
