Label-Semantics-Guided Multi-View Multi-Label Learning via High-Order Semantic Fusion
Kaixiang Wang, Xiaojian Ding, Wanqi Yang, Ming Yang
摘要
Incomplete multi-view multi-label learning faces significant challenges arising from semantic heterogeneity across modalities and incomplete modality availability. Traditional fusion approaches typically emphasize superficial feature alignment, neglecting high-order semantic interactions among modalities and labels, thus resulting in redundant or conflicting information integration. To address these limitations, we propose a novel Label Semantic Guided Adaptive Fusion framework. Specifically, we leverage pretrained language models to generate semantic embeddings for both multi-view data and associated labels, facilitating unified semantic understanding. Subsequently, we construct dual-domain hypergraphs separately within the modality and label semantic spaces to explicitly model complex high-order semantic correlations. Based on these hypergraphs, we employ hypergraph neural networks to mine intrinsic semantic relationships and dynamically assess semantic consistency between each modality and the label space. Finally, an adaptive weighting strategy guided by this semantic consistency measure is introduced to fuse modalities effectively, assigning high weights to modalities with greater semantic alignment. Extensive experiments demonstrate that our LSGMM improves fusion accuracy and robustness over state-of-the-art IMvML methods, confirming the effectiveness of integrating label semantics and high-order semantic relationships into adaptive multi-view fusion.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Hypergraph-Based Multi-View Multi-Label Classification via Adaptive High-Order Semantic FusionYi Shan, Liyang Gao, Yuena Lin, Zhen Yang 等AAAI 2026
- Attention-Induced Embedding Imputation for Incomplete Multi-View Partial Multi-Label ClassificationChengliang Liu, Jinlong Jia, Jie Wen, Yabo Liu 等AAAI 2024 · 被引用 39 次
- HGMF: Heterogeneous Graph-based Fusion for Multimodal Data with IncompletenessJiayi Chen, Aidong ZhangKDD 2020 · 被引用 89 次
- Combining LLM Semantic Reasoning with GNN Structural Modeling for Multi-View Multi-Label Feature SelectionZhiqi Chen, Yuzhou Liu, Jiarui Liu, Wanfu GaoAAAI 2026 · 被引用 1 次
- AdaHGNN: Adaptive Hypergraph Neural Networks for Multi-Label Image ClassificationXiangping Wu, Qingcai Chen, Wei Li, Yulun Xiao 等ACM MM 2020 · 被引用 53 次
