Label-Semantics-Guided Multi-View Multi-Label Learning via High-Order Semantic Fusion
Kaixiang Wang, Xiaojian Ding, Wanqi Yang, Ming Yang
Abstract
Incomplete multi-view multi-label learning faces significant challenges arising from semantic heterogeneity across modalities and incomplete modality availability. Traditional fusion approaches typically emphasize superficial feature alignment, neglecting high-order semantic interactions among modalities and labels, thus resulting in redundant or conflicting information integration. To address these limitations, we propose a novel Label Semantic Guided Adaptive Fusion framework. Specifically, we leverage pretrained language models to generate semantic embeddings for both multi-view data and associated labels, facilitating unified semantic understanding. Subsequently, we construct dual-domain hypergraphs separately within the modality and label semantic spaces to explicitly model complex high-order semantic correlations. Based on these hypergraphs, we employ hypergraph neural networks to mine intrinsic semantic relationships and dynamically assess semantic consistency between each modality and the label space. Finally, an adaptive weighting strategy guided by this semantic consistency measure is introduced to fuse modalities effectively, assigning high weights to modalities with greater semantic alignment. Extensive experiments demonstrate that our LSGMM improves fusion accuracy and robustness over state-of-the-art IMvML methods, confirming the effectiveness of integrating label semantics and high-order semantic relationships into adaptive multi-view fusion.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 1f677150-4d13-4776-ac8c-e0a5300d1d85Related papers
- Hypergraph-Based Multi-View Multi-Label Classification via Adaptive High-Order Semantic FusionYi Shan, Liyang Gao, Yuena Lin, Zhen Yang et al.AAAI 2026
- Attention-Induced Embedding Imputation for Incomplete Multi-View Partial Multi-Label ClassificationChengliang Liu, Jinlong Jia, Jie Wen, Yabo Liu et al.AAAI 2024 · 39 citations
- HGMF: Heterogeneous Graph-based Fusion for Multimodal Data with IncompletenessJiayi Chen, Aidong ZhangKDD 2020 · 89 citations
- Combining LLM Semantic Reasoning with GNN Structural Modeling for Multi-View Multi-Label Feature SelectionZhiqi Chen, Yuzhou Liu, Jiarui Liu, Wanfu GaoAAAI 2026 · 1 citation
- AdaHGNN: Adaptive Hypergraph Neural Networks for Multi-Label Image ClassificationXiangping Wu, Qingcai Chen, Wei Li, Yulun Xiao et al.ACM MM 2020 · 53 citations
