Revisiting Attention in the Dark for Low-Light Person Re-Identiffcation
Xiang Guo, Ruimin Hu, Dongliang Zhu, Mei Wang
Abstract
Person re-identification (Re-ID) under extremely low-light conditions suffers from severe image degradation, which significantly impairs the extraction of identity-discriminative features. Existing methods struggle to recover semantic information that is obscured under poor illumination. To better understand this problem, we conduct a comprehensive analysis of the semantic modeling behavior of Re-ID models in low-light settings. For the first time, we investigate the norm distributions of Query (Q), Key (K), and Value (V) vectors within the attention module and observe that, as illumination decreases, the norm of Query vectors in pedestrian regions drops significantly. This leads to dispersed attention and degraded feature representations. To address this issue, we propose a novel framework named Norm-Ratio Attention and Semantic Recovery Distillation Network (NRSRD), which consists of two key components: a Norm-Ratio Attention Module (NRA) and a Semantic Recovery Distillation Module (SRD). The former dynamically adjusts attention responses based on the ratio of K/Q vector norms, enhancing structural region perception while suppressing background interference. The latter transfers discriminative semantic knowledge from high-illumination auxiliary data to the low-light model, compensating for the semantic degradation caused by poor lighting. Extensive experiments on multiple publicly available low-light Re-ID benchmarks demonstrate the effectiveness and superiority of the proposed method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ffedb950-76b9-434d-a24e-686b09fd9531Builds on20
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- TransReID: Transformer-based Object Re-IdentificationShuting He, Hao Luo, Pichao Wang, Fan Wang et al.ICCV 2021 · 1,172 citations
- Decoupled Knowledge DistillationBorui Zhao, Quan Cui, Renjie Song, Yiyu Qiu et al.CVPR 2022 · 835 citations
- ABD-Net: Attentive but Diverse Person Re-IdentificationTianlong Chen, Shaojin Ding, Jingyi Xie, Ye Yuan et al.ICCV 2019 · 544 citations
- Attention is not all you need: pure attention loses rank doubly exponentially with depthYihe Dong, Jean-Baptiste Cordonnier, Andreas LoukasICML 2021 · 522 citations
Related papers
- Real-World Person Re-Identification via Degradation Invariance LearningYukun Huang, Zheng-Jun Zha, Xueyang Fu, Richang Hong et al.CVPR 2020
- Style Normalization and Restitution for Generalizable Person Re-IdentificationXin Jin, Cuiling Lan, Wenjun Zeng, Zhibo Chen et al.CVPR 2020
- You Do Not Need Additional Priors or Regularizers in Retinex-Based Low-Light Image EnhancementHuiyuan Fu, Wenkai Zheng, Xiangyu Meng, Xin Wang et al.CVPR 2023
- Low-Light Image Enhancement with Multi-stage Residue Quantization and Brightness-aware AttentionYunlong Liu, Tao Huang, Weisheng Dong, Fangfang Wu et al.ICCV 2023 · 39 citations
- Diffusion-Guided Knowledge Distillation for Weakly-Supervised Low-Light Semantic SegmentationChunyan Wang, Dong Zhang, Jinhui TangACM MM 2025 · 1 citation
