MORGAN: To Bridge Mixture of Experts and Spectral Graph Neural Network
Lihui Liu, Yuchen Yan
摘要
Graph Neural Networks (GNNs) have demonstrated strong performance across a wide range of tasks by leveraging the structural properties of graph-structured data. To tackle the challenge of edge heterophily-where connected nodes may possess dissimilar labels or features-two primary families of GNNs have emerged: Mixture-of-Experts (MoE)-based spatial GNNs and frequency filtering-based spectral GNNs. MoE-based spatial GNNs intuitively assign specialized experts to different hops in the graph but often lack a solid theoretical foundation. In contrast, spectral GNNs are grounded in graph signal processing theory, yet they typically rely on handcrafted filters and ad-hoc global operators, which limits their scalability and adaptability. In this work, we uncover an inherent connection between these two paradigms by showing that eigengraph components in spectral methods can be interpreted as experts within the MoE framework. Building on this insight, we propose MORGAN, a novel spectral GNN that combines frequency filtering from spectral GNNs with the expert assignment strategy from MoE-based spatial GNNs. MORGAN performs eigen-decomposition of the graph Laplacian, partitions the spectrum into multiple frequency bands, and assigns a dedicated expert network to each band. A learnable gating mechanism dynamically combines the outputs of these experts based on their spectral characteristics. To support scalable and inductive learning, we further introduce MORGAN(L), a localized variant that incorporates subgraph sampling to perform spectral filtering without requiring access to the full graph Laplacian. Extensive experiments on real-world benchmark datasets demonstrate that MORGAN consistently achieves competitive or superior performance compared to state-of-theart baselines, particularly in inductive node classification tasks under heterophilic settings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper20
- GShard: Scaling Giant Models with Conditional Computation and Automatic ShardingDmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen 等ICLR 2021 · 被引用 1,954 次
- How Attentive are Graph Attention Networks?Shaked Brody, Uri Alon, Eran YahavICLR 2022 · 被引用 1,717 次
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei 等ICLR 2020 · 被引用 1,445 次
- Beyond Low-frequency Information in Graph Convolutional NetworksDeyu Bo, Xiao Wang, Chuan Shi, Huawei ShenAAAI 2021 · 被引用 773 次
- Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple MethodsDerek Lim, Felix Hohne, Xiuyu Li, Sijia Linda Huang 等NeurIPS 2021 · 被引用 534 次
相关 Paper
- HeroFilter: Adaptive Spectral Graph Filter for Varying Heterophilic RelationsShuaicheng Zhang, Haohui Wang, Junhong Lin, Xiaojie Guo 等NeurIPS 2025 · 被引用 5 次
- SLOG: An Inductive Spectral Graph Neural Network Beyond Polynomial FilterHaobo Xu, Yuchen Yan, Dingsu Wang, Zhe Xu 等ICML 2024 · 被引用 24 次
- Hierarchical Multi Scale Graph Neural Networks: Scalable Heterophilous Learning with Oversmoothing and Oversquashing MitigationMD SAZZAD Hossen, Avimanyu SahooICML 2026
- One For All: Achieving Adaptive Graph Neural Networks via Mixture of Message PassingZhaojun Luo, Jintang Li, Yuchang Zhu, Yun Fu 等KDD 2026
- Homophily-Related: Adaptive Hybrid Graph Filter for Multi-View Graph ClusteringZichen Wen, Yawen Ling, Yazhou Ren, Tianyi Wu 等AAAI 2024 · 被引用 24 次
