Cross-View Distillation and Adaptive Masking for Incomplete Multi-View Multi-Label Classification
Yadong Liu, Qiaoqi Li, Yueying Wang, Lunke Fei, Jie Wen
摘要
While existing incomplete multi-view multi-label learning methods have achieved promising performance, few studies have focused on the issue of multi-view imbalance. Existing methods using gradient modulation or alternating optimization strategies alleviate this problem but often oversimplify the interaction between views, resulting in persistently poor performance. In response to the challenge, we propose the Cross-view Distillation and Adaptive Masking (CDAM) framework, a novel approach designed to achieve balanced multi-view optimization for the challenging double incomplete multi-view multi-label learning tasks. First, to overcome the performance bottleneck of views, we design a cross-view distillation module. This module aligns lowquality student representations with high-quality teacher representations, thereby effectively mitigating the multiview imbalance problem. Second, recognizing that distillation may not rectify all low-quality views, we introduce a subsequent adaptive masking module to perform an explicit quality assessment. This module dynamically identifies and masks out any remaining unreliable representations before multi-view fusion, thus preventing low-quality information from corrupting the fused representation. Extensive comparisons with nine state-of-the-art methods on six datasets validate the effectiveness and stability of our method.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper20
- Balanced Multimodal Learning via On-the-fly Gradient ModulationXiaokang Peng, Yake Wei, Andong Deng, Dong Wang 等CVPR 2022 · 被引用 264 次
- Boosting Multi-modal Model Performance with Adaptive Gradient ModulationHong Li, Xingyu Li, Pengbo Hu, Yinuo Lei 等ICCV 2023 · 被引用 84 次
- DICNet: Deep Instance-Level Contrastive Network for Double Incomplete Multi-View Multi-Label ClassificationChengliang Liu, Jie Wen, Xiaoling Luo, Chao Huang 等AAAI 2023 · 被引用 68 次
- Retrieval Augmented Classification for Long-Tail Visual RecognitionAlexander Long, Wei Yin, Thalaiyasingam Ajanthan, Vu Nguyen 等CVPR 2022 · 被引用 64 次
- Class-Distribution-Aware Pseudo-Labeling for Semi-Supervised Multi-Label LearningMing-Kun Xie, Jiahao Xiao, Hao-Zhe Liu, Gang Niu 等NeurIPS 2023 · 被引用 55 次
相关 Paper
- Masked Two-channel Decoupling Framework for Incomplete Multi-view Weak Multi-label LearningChengliang Liu, Jie Wen, Yabo Liu, Chao Huang 等NeurIPS 2023 · 被引用 32 次
- Quality-aware and Soft Consistency Driven Representation Fusion for Incomplete Multi-view Multi-label ClassificationYadong Liu, Waikeung Wong, Yulong Chen, Jie WenAAAI 2026
- Incomplete Multi-View Multi-Label Classification via Shared Codebook and Fused-Teacher Self-DistillationXu Yan, Jun Yin, Shiliang Sun, Minghua WanICLR 2026
- Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware TransformersChengliang Liu, Jie Wen, Xiaoling Luo, Yong XuAAAI 2023 · 被引用 68 次
- A Unified Self-Distillation Framework for Multimodal Sentiment Analysis with Uncertain Missing ModalitiesMingcheng Li, Dingkang Yang, Yuxuan Lei, Shunli Wang 等AAAI 2024 · 被引用 71 次
