Global-Semantic Alignment Distillation for Partial Multi-view Classification
Xiaoli Wang, Anqi Huang, Yongli Wang, Guanzhou Ke, Xiaobin Hong, Jun Liu
Abstract
Partial multi-view classification (PMvC) poses a significant challenge due to the incomplete nature of multi-view data, which complicates effective information fusion and accurate classification. Existing PMvC methods typically rely on heuristic evaluations of view informativeness to achieve global alignment for downstream classification tasks. However, these approaches suffer from two critical issues: information redundancy and semantic misalignment. The complexity of missing data not only leads to over-reliance on redundant or less informative views but also exacerbates semantic misalignment across views, making it difficult for existing methods to effectively capture and discriminate the task-related features. To address these issues, this work proposes a novel GLobalsemantic Alignment Distillation (GLAD) paradigm for partial multi-view classification, implemented in an imputation-free manner. Our approach incorporates a self-distillation mechanism that enables the model to extract informative features and achieve global semantic alignment across views. The key insight of GLAD is leveraging the ground truth as semantic anchors to guide the alignment of partial multi-view features. By integrating the high-level semantics with extracted features via a cross-attention mechanism, we generate ideal embeddings that consistently capture global semantics across views. These embeddings then serve as intermediate supervision for distilling the student model, ensuring robust semantic alignment even with missing views. Furthermore, we introduce a margin-aware weighting strategy to enhance the model's discriminative ability. Extensive experimental results validate the effectiveness and superiority of the proposed method, showcasing significant improvements in classification performance over existing techniques.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5ea40f86-5078-42b2-8982-3311b9b85a5eCited by top-tier papers1
Ask how each one uses itBuilds on19
- Multi-view Contrastive Graph ClusteringErlin Pan, Zhao KangNeurIPS 2021 · 316 citations
- Cross-Modality Attention with Semantic Graph Embedding for Multi-Label ClassificationRenchun You, Zhiyao Guo, Lei Cui, Xiang Long et al.AAAI 2020 · 221 citations
- Multimodal Dynamics: Dynamical Fusion for Trustworthy Multimodal ClassificationZongbo Han, Fan Yang, Junzhou Huang, Changqing Zhang et al.CVPR 2022 · 149 citations
- Reliable Conflictive Multi-View LearningCai Xu, Jiajun Si, Ziyu Guan, Wei Zhao et al.AAAI 2024 · 121 citations
- Self-Weighted Contrastive Learning among Multiple Views for Mitigating Representation DegenerationJie Xu, Shuo Chen, Yazhou Ren, Xiaoshuang Shi et al.NeurIPS 2023 · 71 citations
Related papers
- Incomplete Multi-View Multi-Label Classification via Shared Codebook and Fused-Teacher Self-DistillationXu Yan, Jun Yin, Shiliang Sun, Minghua WanICLR 2026
- Dual-Level Distribution Alignment for Deep Incomplete Multi-View ClusteringFujian Ren, Wenlan Chen, Lu Gao, Fei Guo et al.ACM MM 2025
- Dual Structure-guided Contrastive Network for Incomplete Multi-view Partial Multi-label ClassificationKaixin Xu, Yangyang Wu, Shijun Wu, Xiaoye Miao et al.KDD 2025
- Attention-Induced Embedding Imputation for Incomplete Multi-View Partial Multi-Label ClassificationChengliang Liu, Jinlong Jia, Jie Wen, Yabo Liu et al.AAAI 2024 · 39 citations
- Cross-View Distillation and Adaptive Masking for Incomplete Multi-View Multi-Label ClassificationYadong Liu, Qiaoqi Li, Yueying Wang, Lunke Fei et al.CVPR 2026
