Intra-class Distribution-guided Generative Hashing with Neighbor Refinement for Cross-modal Retrieval
Hao Sun, Yadong Huo, Qibing Qin, Wenfeng Zhang, Lei Huang
Abstract
Recent cross-modal hashing methods have introduced sample generation strategies to enrich training signals. Despite these advances, sample generation-driven hashing still faces two major challenges: (1) Interpolation-based methods adopt deterministic and class-independent generation that restricts synthetic samples to a small region around the original data. Consequently, intra-class diversity is limited, which weakens the model’s ability to learn discriminative binary codes. (2) Generation network-based methods, which leverage a complex generative model to produce synthetic samples, leading to extra model complexity. To address these issues, we propose a novel Intra-class Distribution-guided Generative Hashing (IDGH) that adaptively generates synthetic samples directly from estimated intra-class distributions. Specifically, we suggest an Intra-class Distribution Estimation (IDE) scheme to model the characteristic distribution of each class, providing essential support for adaptive sample generation. Meanwhile, by utilizing the distribution information from neighboring classes, we design a Neighbor-guided Distribution Refinement (NDR) mechanism to correct flawed estimations for classes. With refined intra-class distributions, we propose a Distribution-aware Adaptive Generation (DAG) strategy that synthesizes informative training samples by shifting features along diverse directions guided by intra-class distribution patterns. The proposed approach is plug-and-play and can be seamlessly integrated into various objective functions, providing semantically diverse training samples, thus enhancing similarity learning. Extensive experiments on benchmark datasets demonstrate that IDGH outperforms existing methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e2a8c854-40c7-4a70-8494-8d7cf40dd963Builds on13
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Differentiable Cross-modal Hashing via Multimodal TransformersJunfeng Tu, Xueliang Liu, Zongxiang Lin, Richang Hong et al.ACM MM 2022 · 93 citations
- SSAH: Semi-Supervised Adversarial Deep Hashing with Self-Paced Hard Sample GenerationSheng Jin, Shangchen Zhou, Yao Liu, Chao Chen et al.AAAI 2020 · 35 citations
- Dual Self-Paced Cross-Modal HashingYuan Sun, Jian Dai, Zhenwen Ren, Yingke Chen et al.AAAI 2024 · 35 citations
- M3R: Masked Token Mixup and Cross-Modal Reconstruction for Zero-Shot LearningPeng Zhao, Qiangchang Wang, Yilong YinACM MM 2023 · 8 citations
Related papers
- Data-Aware Proxy Hashing for Cross-modal RetrievalRong-Cheng Tu, Xian-Ling Mao, Wenjin Ji, Wei Wei et al.SIGIR 2023 · 32 citations
- Deep Global-sense Hard-negative Discriminative Generation Hashing for Cross-modal RetrievalKun Cheng, Qibing Qin, Wenfeng Zhang, Lei Huang et al.ICLR 2026
- Distribution Consistency Guided Hashing for Cross-Modal RetrievalYuan Sun, Kaiming Liu, Yongxiang Li, Zhenwen Ren et al.ACM MM 2024 · 11 citations
- Unsupervised Hashing with Contrastive Learning by Exploiting Similarity Knowledge and Hidden Structure of DataZhenpeng Song, Qinliang Su, Jiayang ChenACM MM 2023 · 7 citations
- Deep Discriminative Structure Proxy Hashing for Cross-modal RetrievalKun Cheng, Qibing Qin, Lei HuangICML 2026
