Towards Cross-Modal Preservation, Consistency and Alignment for Privacy-Preserving Visible-Infrared Person Re-Identification
Yudi Xie, Zhongao Zhou, Bin Yang, Zhenghan Chen, Mang Ye
摘要
Privacy-preserving Person Re-Identification (PP-ReID) addresses the core privacy-utility trade-off in Re-ID by retrieving a person across multiple non-overlapping cameras while applying anonymization techniques to protect sensitive information. However, prior PP-ReID studies are confined to single-modality visible scenarios, as 24-hour surveillance systems require robust cross-modal visible-infrared (VI) capabilities. Extending PP-ReID to the cross-modal VI setting is therefore crucial for 24-hour surveillance. Accordingly, we introduce a new task: Privacy-Preserving Visible-Infrared Person Re-Identification (PP-VI-ReID). This task presents two severe challenges: 1) Crude anonymization strategies destroy identity-critical information and disrupt cross-modal alignment 2) The anonymization process creates inconsistent distortions across modalities. It disrupts color-based textures in visible images while obscuring thermal contours in infrared images. This inconsistency with modality gap forms a Mixed Gap. To overcome these challenges, we propose a framework, the Precise Privacy-preserving and Alignment Network (PPA) with two components: 1) A Keypoint-Preserving Regularization (KPR) module leverages human pose as a prior to guide structure-aware anonymization, preserving essential body features. 2) A Differential Consistency-guided Modality Alignment (DCMA) module. It treats anonymization perturbations not as varying noise, but as a stable, learnable offset, facilitating robust alignment between raw and anonymized features across modalities. Experiments on SYSU-MM01 and RegDB validate our framework, establishing a strong baseline for this task. The source code will be released.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper20
- Infrared-Visible Cross-Modal Person Re-Identification with an X ModalityDiangang Li, Xing Wei, Xiaopeng Hong, Yihong GongAAAI 2020 · 被引用 419 次
- Learning with Twin Noisy Labels for Visible-Infrared Person Re-IdentificationMouxing Yang, Zhenyu Huang, Peng Hu, Taihao Li 等CVPR 2022 · 被引用 248 次
- Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal CorrespondencesHyunjong Park, Sanghoon Lee, Junghyup Lee, Bumsub HamICCV 2021 · 被引用 248 次
- Learning Progressive Modality-Shared Transformers for Effective Visible-Infrared Person Re-identificationHu Lu, Xuezhang Zou, Pingping ZhangAAAI 2023 · 被引用 183 次
- Live Face De-Identification in VideoOran Gafni, Lior Wolf, Yaniv TaigmanICCV 2019 · 被引用 154 次
相关 Paper
- Joint Color-irrelevant Consistency Learning and Identity-aware Modality Adaptation for Visible-infrared Cross Modality Person Re-identificationZhiwei Zhao, Bin Liu, Qi Chu, Yan Lu 等AAAI 2021 · 被引用 92 次
- Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-IdentificationSeokeon Choi, Sumin Lee, Youngeun Kim, Taekyung Kim 等CVPR 2020
- Not All Pixels Are Matched: Dense Contrastive Learning for Cross-Modality Person Re-IdentificationHanzhe Sun, Jun Liu, Zhizhong Zhang, Chengjie Wang 等ACM MM 2022 · 被引用 87 次
- Keypoint-Guided Modality-Invariant Discriminative Learning for Visible-Infrared Person Re-identificationTengfei Liang, Yi Jin, Wu Liu, Songhe Feng 等ACM MM 2022 · 被引用 19 次
- BIT: Matching-based Bi-directional Interaction Transformation Network for Visible-Infrared Person Re-IdentificationHaoxuan Xu, Guanglin NiuCVPR 2026 · 被引用 3 次
