Cross-View Distillation and Adaptive Masking for Incomplete Multi-View Multi-Label Classification
Yadong Liu, Qiaoqi Li, Yueying Wang, Lunke Fei, Jie Wen
Abstract
While existing incomplete multi-view multi-label learning methods have achieved promising performance, few studies have focused on the issue of multi-view imbalance. Existing methods using gradient modulation or alternating optimization strategies alleviate this problem but often oversimplify the interaction between views, resulting in persistently poor performance. In response to the challenge, we propose the Cross-view Distillation and Adaptive Masking (CDAM) framework, a novel approach designed to achieve balanced multi-view optimization for the challenging double incomplete multi-view multi-label learning tasks. First, to overcome the performance bottleneck of views, we design a cross-view distillation module. This module aligns lowquality student representations with high-quality teacher representations, thereby effectively mitigating the multiview imbalance problem. Second, recognizing that distillation may not rectify all low-quality views, we introduce a subsequent adaptive masking module to perform an explicit quality assessment. This module dynamically identifies and masks out any remaining unreliable representations before multi-view fusion, thus preventing low-quality information from corrupting the fused representation. Extensive comparisons with nine state-of-the-art methods on six datasets validate the effectiveness and stability of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b71a4a5c-d0ab-476c-959b-6615ac9232f4Builds on20
- Balanced Multimodal Learning via On-the-fly Gradient ModulationXiaokang Peng, Yake Wei, Andong Deng, Dong Wang et al.CVPR 2022 · 264 citations
- Boosting Multi-modal Model Performance with Adaptive Gradient ModulationHong Li, Xingyu Li, Pengbo Hu, Yinuo Lei et al.ICCV 2023 · 84 citations
- DICNet: Deep Instance-Level Contrastive Network for Double Incomplete Multi-View Multi-Label ClassificationChengliang Liu, Jie Wen, Xiaoling Luo, Chao Huang et al.AAAI 2023 · 68 citations
- Retrieval Augmented Classification for Long-Tail Visual RecognitionAlexander Long, Wei Yin, Thalaiyasingam Ajanthan, Vu Nguyen et al.CVPR 2022 · 64 citations
- Class-Distribution-Aware Pseudo-Labeling for Semi-Supervised Multi-Label LearningMing-Kun Xie, Jiahao Xiao, Hao-Zhe Liu, Gang Niu et al.NeurIPS 2023 · 55 citations
Related papers
- Masked Two-channel Decoupling Framework for Incomplete Multi-view Weak Multi-label LearningChengliang Liu, Jie Wen, Yabo Liu, Chao Huang et al.NeurIPS 2023 · 32 citations
- Quality-aware and Soft Consistency Driven Representation Fusion for Incomplete Multi-view Multi-label ClassificationYadong Liu, Waikeung Wong, Yulong Chen, Jie WenAAAI 2026
- Incomplete Multi-View Multi-Label Classification via Shared Codebook and Fused-Teacher Self-DistillationXu Yan, Jun Yin, Shiliang Sun, Minghua WanICLR 2026
- Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware TransformersChengliang Liu, Jie Wen, Xiaoling Luo, Yong XuAAAI 2023 · 68 citations
- A Unified Self-Distillation Framework for Multimodal Sentiment Analysis with Uncertain Missing ModalitiesMingcheng Li, Dingkang Yang, Yuxuan Lei, Shunli Wang et al.AAAI 2024 · 71 citations
