Intra-class Distribution-guided Generative Hashing with Neighbor Refinement for Cross-modal Retrieval
Hao Sun, Yadong Huo, Qibing Qin, Wenfeng Zhang, Lei Huang
摘要
Recent cross-modal hashing methods have introduced sample generation strategies to enrich training signals. Despite these advances, sample generation-driven hashing still faces two major challenges: (1) Interpolation-based methods adopt deterministic and class-independent generation that restricts synthetic samples to a small region around the original data. Consequently, intra-class diversity is limited, which weakens the model’s ability to learn discriminative binary codes. (2) Generation network-based methods, which leverage a complex generative model to produce synthetic samples, leading to extra model complexity. To address these issues, we propose a novel Intra-class Distribution-guided Generative Hashing (IDGH) that adaptively generates synthetic samples directly from estimated intra-class distributions. Specifically, we suggest an Intra-class Distribution Estimation (IDE) scheme to model the characteristic distribution of each class, providing essential support for adaptive sample generation. Meanwhile, by utilizing the distribution information from neighboring classes, we design a Neighbor-guided Distribution Refinement (NDR) mechanism to correct flawed estimations for classes. With refined intra-class distributions, we propose a Distribution-aware Adaptive Generation (DAG) strategy that synthesizes informative training samples by shifting features along diverse directions guided by intra-class distribution patterns. The proposed approach is plug-and-play and can be seamlessly integrated into various objective functions, providing semantically diverse training samples, thus enhancing similarity learning. Extensive experiments on benchmark datasets demonstrate that IDGH outperforms existing methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Differentiable Cross-modal Hashing via Multimodal TransformersJunfeng Tu, Xueliang Liu, Zongxiang Lin, Richang Hong 等ACM MM 2022 · 被引用 93 次
- SSAH: Semi-Supervised Adversarial Deep Hashing with Self-Paced Hard Sample GenerationSheng Jin, Shangchen Zhou, Yao Liu, Chao Chen 等AAAI 2020 · 被引用 35 次
- Dual Self-Paced Cross-Modal HashingYuan Sun, Jian Dai, Zhenwen Ren, Yingke Chen 等AAAI 2024 · 被引用 35 次
- M3R: Masked Token Mixup and Cross-Modal Reconstruction for Zero-Shot LearningPeng Zhao, Qiangchang Wang, Yilong YinACM MM 2023 · 被引用 8 次
相关 Paper
- Data-Aware Proxy Hashing for Cross-modal RetrievalRong-Cheng Tu, Xian-Ling Mao, Wenjin Ji, Wei Wei 等SIGIR 2023 · 被引用 32 次
- Deep Global-sense Hard-negative Discriminative Generation Hashing for Cross-modal RetrievalKun Cheng, Qibing Qin, Wenfeng Zhang, Lei Huang 等ICLR 2026
- Distribution Consistency Guided Hashing for Cross-Modal RetrievalYuan Sun, Kaiming Liu, Yongxiang Li, Zhenwen Ren 等ACM MM 2024 · 被引用 11 次
- Unsupervised Hashing with Contrastive Learning by Exploiting Similarity Knowledge and Hidden Structure of DataZhenpeng Song, Qinliang Su, Jiayang ChenACM MM 2023 · 被引用 7 次
- Deep Discriminative Structure Proxy Hashing for Cross-modal RetrievalKun Cheng, Qibing Qin, Lei HuangICML 2026
