Pairing-free Group-level Knowledge Distillation for Robust Gastrointestinal Lesion Classification in White-Light Endoscopy
Qiang Hu, Qimei Wang, Yingjie Guo, Qiang Li, Zhiwei Wang
Abstract
White-Light Imaging (WLI) is the standard for endoscopic cancer screening, but Narrow-Band Imaging (NBI) offers superior diagnostic details. A key challenge is transferring knowledge from NBI to enhance WLI-only models, yet existing methods are critically hampered by their reliance on paired NBI-WLI images of the same lesion, a costly and often impractical requirement that leaves vast amounts of clinical data untapped. In this paper, we break this paradigm by introducing PaGKD, a novel Pairing-free Group-level Knowledge Distillation framework that that enables effective cross-modal learning using unpaired WLI and NBI data. Instead of forcing alignment between individual, often semantically mismatched image instances, PaGKD operates at the group level to distill more complete and compatible knowledge across modalities. Central to PaGKD are two complementary modules: (1) Group-level Prototype Distillation (GKD-Pro) distills compact group representations by extracting modality-invariant semantic prototypes via shared lesionaware queries; (2) Group-level Dense Distillation (GKD-Den) performs dense cross-modal alignment by guiding group-aware attention with activation-derived relation maps. Together, these modules enforce global semantic consistency and local structural coherence without requiring imagelevel correspondence. Extensive experiments on four clinical datasets demonstrate that PaGKD consistently and significantly outperforms state-of-the-art methods, achieving relative AUC improvements of 3.3%, 1.1%, 2.8%, and 3.2%, respectively, establishing a new direction for cross-modal learning from unpaired data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 891ef1ac-e35a-4a8d-afc7-2da30bd72ecdBuilds on4
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with TransformersLixiang Ru, Yibing Zhan, Baosheng Yu, Bo DuCVPR 2022 · 257 citations
- Towards Cross-Modality Medical Image Segmentation with Online Mutual Knowledge DistillationKang Li, Lequan Yu, Shujun Wang, Pheng-Ann HengAAAI 2020 · 115 citations
- Auxiliary Modality Learning with Generalized Curriculum DistillationYu Shen, Xijun Wang, Peng Gao, Ming C. LinICML 2023 · 13 citations
Related papers
- Cross-Modal Knowledge Distillation without Paired Data: Theoretical Foundation and AlgorithmT. K Tran, Duc Chu Anh, Quang Hung Pham, Phi Le Nguyen et al.ICML 2026
- Asymmetric Cross-Modal Knowledge Distillation: Bridging Modalities with Weak Semantic ConsistencyRiling Wei, Kelu Yao, Chuanguang Yang, Jin Wang et al.AAAI 2026
- What Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions SegmentationJiahua Dong, Yang Cong, Gan Sun, Bineng Zhong et al.CVPR 2020
- Prototypical Cross-domain Knowledge Transfer for Cervical Dysplasia Visual InspectionYichen Zhang, Yifang Yin, Ying Zhang, Zhenguang Liu et al.ACM MM 2023 · 4 citations
- From Infusion to Assimilation Distillation for Medical Image SegmentationJiankang Hong, Ye Luo, Yinan Liu, Junsong YuanCVPR 2026
