MORGAN: To Bridge Mixture of Experts and Spectral Graph Neural Network
Lihui Liu, Yuchen Yan
Abstract
Graph Neural Networks (GNNs) have demonstrated strong performance across a wide range of tasks by leveraging the structural properties of graph-structured data. To tackle the challenge of edge heterophily-where connected nodes may possess dissimilar labels or features-two primary families of GNNs have emerged: Mixture-of-Experts (MoE)-based spatial GNNs and frequency filtering-based spectral GNNs. MoE-based spatial GNNs intuitively assign specialized experts to different hops in the graph but often lack a solid theoretical foundation. In contrast, spectral GNNs are grounded in graph signal processing theory, yet they typically rely on handcrafted filters and ad-hoc global operators, which limits their scalability and adaptability. In this work, we uncover an inherent connection between these two paradigms by showing that eigengraph components in spectral methods can be interpreted as experts within the MoE framework. Building on this insight, we propose MORGAN, a novel spectral GNN that combines frequency filtering from spectral GNNs with the expert assignment strategy from MoE-based spatial GNNs. MORGAN performs eigen-decomposition of the graph Laplacian, partitions the spectrum into multiple frequency bands, and assigns a dedicated expert network to each band. A learnable gating mechanism dynamically combines the outputs of these experts based on their spectral characteristics. To support scalable and inductive learning, we further introduce MORGAN(L), a localized variant that incorporates subgraph sampling to perform spectral filtering without requiring access to the full graph Laplacian. Extensive experiments on real-world benchmark datasets demonstrate that MORGAN consistently achieves competitive or superior performance compared to state-of-theart baselines, particularly in inductive node classification tasks under heterophilic settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eaa02477-705e-46dd-9eb7-3e72f02774aeCited by top-tier papers1
Ask how each one uses itBuilds on20
- GShard: Scaling Giant Models with Conditional Computation and Automatic ShardingDmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen et al.ICLR 2021 · 1,954 citations
- How Attentive are Graph Attention Networks?Shaked Brody, Uri Alon, Eran YahavICLR 2022 · 1,717 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Beyond Low-frequency Information in Graph Convolutional NetworksDeyu Bo, Xiao Wang, Chuan Shi, Huawei ShenAAAI 2021 · 773 citations
- Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple MethodsDerek Lim, Felix Hohne, Xiuyu Li, Sijia Linda Huang et al.NeurIPS 2021 · 534 citations
Related papers
- HeroFilter: Adaptive Spectral Graph Filter for Varying Heterophilic RelationsShuaicheng Zhang, Haohui Wang, Junhong Lin, Xiaojie Guo et al.NeurIPS 2025 · 5 citations
- SLOG: An Inductive Spectral Graph Neural Network Beyond Polynomial FilterHaobo Xu, Yuchen Yan, Dingsu Wang, Zhe Xu et al.ICML 2024 · 24 citations
- Hierarchical Multi Scale Graph Neural Networks: Scalable Heterophilous Learning with Oversmoothing and Oversquashing MitigationMD SAZZAD Hossen, Avimanyu SahooICML 2026
- One For All: Achieving Adaptive Graph Neural Networks via Mixture of Message PassingZhaojun Luo, Jintang Li, Yuchang Zhu, Yun Fu et al.KDD 2026
- Homophily-Related: Adaptive Hybrid Graph Filter for Multi-View Graph ClusteringZichen Wen, Yawen Ling, Yazhou Ren, Tianyi Wu et al.AAAI 2024 · 24 citations
