Alternately Optimized Graph Neural Networks
Haoyu Han, Xiaorui Liu, Haitao Mao, MohamadAli Torkamani, Feng Shi, Victor Lee, Jiliang Tang
Abstract
Graph Neural Networks (GNNs) have greatly advanced the semi-supervised node classification task on graphs. The majority of existing GNNs are trained in an end-to-end manner that can be viewed as tackling a bi-level optimization problem. This process is often inefficient in computation and memory usage. In this work, we propose a new optimization framework for semisupervised learning on graphs from a multi-view learning perspective. The proposed framework can be conveniently solved by the alternating optimization algorithms, resulting in significantly improved efficiency. Extensive experiments demonstrate that the proposed method can achieve comparable or better performance with state-of-the-art baselines while it has significantly better computation and memory efficiency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- No Change, No Gain: Empowering Graph Neural Networks with Expected Model Change Maximization for Active LearningZixing Song, Yifei Zhang, Irwin KingNeurIPS 2023 · 21 citations
- Investigating Out-of-Distribution Generalization of GNNs: An Architecture PerspectiveKai Guo, Hongzhi Wen, Wei Jin, Yaming Guo et al.KDD 2024 · 7 citations
- Domain Adaptive Unfolded Graph Neural NetworksZepeng Zhang, Olga FinkAAAI 2025 · 1 citation
- Depth-Adaptive Graph Neural Networks via Learnable Bakry-Émery CurvatureAsela Hevapathige, Ahad N. Zehmakan, Qing WangKDD 2025
Builds on17
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann et al.NeurIPS 2020 · 1,490 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- GraphSAINT: Graph Sampling Based Inductive Learning MethodHanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan et al.ICLR 2020 · 1,155 citations
Related papers
- Redundancy-Free Computation for Graph Neural NetworksZhihao Jia, Sina Lin, Rex Ying, Jiaxuan You et al.KDD 2020 · 60 citations
- Structural Fairness-aware Active Learning for Graph Neural NetworksHaoyu Han, Xiaorui Liu, Li Ma, MohamadAli Torkamani et al.ICLR 2024 · 5 citations
- Meta-Inductive Node Classification across GraphsZhihao Wen, Yuan Fang, Zemin LiuSIGIR 2021 · 31 citations
- Towards Label Position Bias in Graph Neural NetworksHaoyu Han, Xiaorui Liu, Feng Shi, MohamadAli Torkamani et al.NeurIPS 2023 · 8 citations
- Descent Steps of a Relation-Aware Energy Produce Heterogeneous Graph Neural NetworksHongjoon Ahn, Yongyi Yang, Quan Gan, Taesup Moon et al.NeurIPS 2022 · 30 citations
