Incomplete Multi-View Multi-Label Classification via Shared Codebook and Fused-Teacher Self-Distillation
Xu Yan, Jun Yin, Shiliang Sun, Minghua Wan
Abstract
Although multi-view multi-label learning has been extensively studied, research on the dual-missing scenario, where both views and labels are incomplete, remains largely unexplored. Existing methods mainly rely on contrastive learning or information bottleneck theory to learn consistent representations under missing-view conditions, but loss-based alignment without explicit structural constraints limits the ability to capture stable and discriminative shared semantics. To address this issue, we introduce a more structured mechanism for consistent representation learning: we learn discrete consistent representations through a multi-view shared codebook and cross-view reconstruction, which naturally align different views within the limited shared codebook embeddings and reduce feature redundancy. At the decision level, we design a weight estimation method that evaluates the ability of each view to preserve label correlation structures, assigning weights accordingly to enhance the quality of the fused prediction. In addition, we introduce a fused-teacher self-distillation framework, where the fused prediction guides the training of view-specific classifiers and feeds the global knowledge back into the single-view branches, thereby enhancing the generalization ability of the model under missing-label conditions. The effectiveness of our proposed method is thoroughly demonstrated through extensive comparative experiments with advanced methods on five benchmark datasets. Code is available at https://github.com/xuy11/SCSD .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on12
- Asymmetric Loss For Multi-Label ClassificationTal Ridnik, Emanuel Ben Baruch, Nadav Zamir, Asaf Noy et al.ICCV 2021 · 778 citations
- Vector-quantized Image Modeling with Improved VQGANJiahui Yu, Xin Li, Jing Yu Koh, Han Zhang et al.ICLR 2022 · 753 citations
- vq-wav2vec: Self-Supervised Learning of Discrete Speech RepresentationsAlexei Baevski, Steffen Schneider, Michael AuliICLR 2020 · 730 citations
- DICNet: Deep Instance-Level Contrastive Network for Double Incomplete Multi-View Multi-Label ClassificationChengliang Liu, Jie Wen, Xiaoling Luo, Chao Huang et al.AAAI 2023 · 68 citations
- Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware TransformersChengliang Liu, Jie Wen, Xiaoling Luo, Yong XuAAAI 2023 · 68 citations
Related papers
- Incomplete Multi-View Multi-label Learning via Disentangled Representation and Label Semantic EmbeddingXu Yan, Jun Yin, Jie WenCVPR 2025
- Learning Compact Semantic Information for Incomplete Multi-View Missing Multi-Label ClassificationJie Wen, Yadong Liu, Zhanyan Tang, Yuting He et al.ICML 2025
- Dual Structure-guided Contrastive Network for Incomplete Multi-view Partial Multi-label ClassificationKaixin Xu, Yangyang Wu, Shijun Wu, Xiaoye Miao et al.KDD 2025
- Quality-aware and Soft Consistency Driven Representation Fusion for Incomplete Multi-view Multi-label ClassificationYadong Liu, Waikeung Wong, Yulong Chen, Jie WenAAAI 2026
- Cross-View Distillation and Adaptive Masking for Incomplete Multi-View Multi-Label ClassificationYadong Liu, Qiaoqi Li, Yueying Wang, Lunke Fei et al.CVPR 2026
