Cooperation of Experts: Fusing Heterogeneous Information with Large Margin
Shuo Wang, Shunyang Huang, Jinghui Yuan, Zhixiang Shen, Zhao Kang
Abstract
Fusing heterogeneous information remains a persistent challenge in modern data analysis. While significant progress has been made, existing approaches often fail to account for the inherent heterogeneity of object patterns across different semantic spaces. To address this limitation, we propose the Cooperation of Experts (CoE) framework, which encodes multi-typed information into unified heterogeneous multiplex networks. By transcending modality and connection differences, CoE provides a powerful and flexible model for capturing the intricate structures of real-world complex data. In our framework, dedicated encoders act as domain-specific experts, each specializing in learning distinct relational patterns in specific semantic spaces. To enhance robustness and extract complementary knowledge, these experts collaborate through a novel large margin mechanism supported by a tailored optimization strategy. Rigorous theoretical analyses guarantee the framework's feasibility and stability, while extensive experiments across diverse benchmarks demonstrate its superior performance and broad applicability. Our code is available at https: //github.com/strangeAlan/CoE .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1f26bfda-ffb7-410c-bbba-c3219685369dCited by top-tier papers4
- InfMasking: Unleashing Synergistic Information by Contrastive Multimodal InteractionsLiangjian Wen, Qun Dai, Jianzhuang Liu, Jiangtao Zheng et al.NeurIPS 2025 · 10 citations
- Structure-Centric Graph Foundation Model via Geometric BasesXiaodong He, Haolan He, Ruiyi Fang, Ming Sun et al.ICML 2026 · 1 citation
- Disentangling Homophily and Heterophily in Multimodal Graph ClusteringZhaochen Guo, Zhixiang Shen, Xuanting Xie, Liangjian Wen et al.ACM MM 2025 · 1 citation
- SAGA: Structural Aggregation Guided Alignment with Dynamic View and Neighborhood Order Selection for Multiview Graph Domain AdaptationRuiyi Fang, Jingyu Zhao, Shuo Wang, Ruizhi Pu et al.ICLR 2026
Builds on31
- Graph Structure Learning for Robust Graph Neural NetworksWei Jin, Yao Ma, Xiaorui Liu, Xianfeng Tang et al.KDD 2020 · 604 citations
- Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node EmbeddingsYu Chen, Lingfei Wu, Mohammed J. ZakiNeurIPS 2020 · 559 citations
- NodeFormer: A Scalable Graph Structure Learning Transformer for Node ClassificationQitian Wu, Wentao Zhao, Zenan Li, David P. Wipf et al.NeurIPS 2022 · 472 citations
- Learning Robust Representations via Multi-View Information BottleneckMarco Federici, Anjan Dutta, Patrick Forré, Nate Kushman et al.ICLR 2020 · 330 citations
- Heterogeneous Graph Structure Learning for Graph Neural NetworksJianan Zhao, Xiao Wang, Chuan Shi, Binbin Hu et al.AAAI 2021 · 306 citations
Related papers
- AnomalyMoE: Towards a Language-free Generalist Model for Unified Visual Anomaly DetectionZhaopeng Gu, Bingke Zhu, Guibo Zhu, Yingying Chen et al.AAAI 2026 · 3 citations
- RTE-GMoE: A Model-agnostic Approach for Relation Triplet Extraction via Graph-based Mixture-of-Expert Mutual LearningAziguli Wulamu, Kaiyuan Gong, Lyu Zhengyu, Yu Han et al.EMNLP 2025 · 1 citation
- Multi-View Differential Mixing and Graph-Guided Structural Region Selection for Cross-Modal AlignmentLinlin Ji, Li LiuAAAI 2026
- On Modality Weighting and Specificity for Multi-Modal Entity AlignmentYu Xing, Qizhuo Xie, Yunhui Liu, Qing Gu et al.AAAI 2026
- Deep Co-Attention Network for Multi-View Subspace LearningLecheng Zheng, Yu Cheng, Hongxia Yang, Nan Cao et al.WWW 2021 · 37 citations
