PMPGuard: Catching Pseudo-Matched Pairs in Remote Sensing Image-Text Retrieval
Pengxiang Ouyang, Qing Ma, Zheng Wang, Cong Bai
Abstract
Remote sensing (RS) image–text retrieval faces significant challenges in real-world datasets due to the presence of Pseudo-Matched Pairs (PMPs), semantically mismatched or weakly aligned image–text pairs, which hinder the learning of reliable cross-modal alignments. To address this issue, we propose a novel retrieval framework that leverages Cross-Modal Gated Attention and a Positive–Negative Awareness Attention mechanism to mitigate the impact of such noisy associations. The gated module dynamically regulates cross-modal information flow, while the awareness mechanism explicitly distinguishes informative (positive) cues from misleading (negative) ones during alignment learning. Extensive experiments on three benchmark RS datasets, i.e., RSICD, RSITMD, and RS5M, demonstrate that our method consistently achieves state-of-the-art performance, highlighting its robustness and effectiveness in handling real-world mismatches and PMPs in RS image–text retrieval tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f622c3e9-d2f7-47b2-8d2a-efb04e5177daBuilds on12
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
- Dynamic Modality Interaction Modeling for Image-Text RetrievalLeigang Qu, Meng Liu, Jianlong Wu, Zan Gao et al.SIGIR 2021 · 187 citations
- Deep Evidential Learning with Noisy Correspondence for Cross-modal RetrievalYang Qin, Dezhong Peng, Xi Peng, Xu Wang et al.ACM MM 2022 · 101 citations
- A Prior Instruction Representation Framework for Remote Sensing Image-text RetrievalJiancheng Pan, Qing Ma, Cong BaiACM MM 2023 · 52 citations
Related papers
- Entity-Level Alignment with Prompt-Guided Adapter for Remote Sensing Image-Text RetrievalShuoshuo Li, Shuli Cheng, Liejun WangACM MM 2025 · 2 citations
- Robust Remote Sensing Image–Text Retrieval with Noisy Correspondenceqiya song, Yiqiang Xie, Yuan Sun, Renwei Dian et al.CVPR 2026 · 1 citation
- Negative-Aware Attention Framework for Image-Text MatchingKun Zhang, Zhendong Mao, Quan Wang, Yongdong ZhangCVPR 2022 · 185 citations
- Learning Audio-guided Video Representation with Gated Attention for Video-Text RetrievalBoseung Jeong, Jicheol Park, Sungyeon Kim, Suha KwakCVPR 2025
- Robust Semi-paired Multimodal Learning for Cross-modal RetrievalYang Qin, Yuan Sun, Xi Peng, Dezhong Peng et al.AAAI 2026
