Search to aggregate neighborhood for graph neural network
Huan Zhao, Quanming Yao, Weiwei Tu
Abstract
Recent years have witnessed the popularity and success of graph neural networks (GNN) in various scenarios. To obtain data-specific GNN architectures, researchers turn to neural architecture search (NAS), which have made impressive success in discovering effective architectures in convolutional neural networks. However, it is non-trivial to apply NAS approaches to GNN due to challenges in search space design and expensive searching cost of existing NAS methods. In this work, to obtain the data-specific GNN architectures and address the computational challenges facing by NAS approaches, we propose a framework, which tries to Search to Aggregate NEighborhood (SANE), to automatically design data-specific GNN architectures. By designing a novel and expressive search space, we propose a differentiable search algorithm, which is more efficient than previous reinforcement learning based methods. Experimental results on four tasks and seven real-world datasets demonstrate the superiority of SANE compared to existing GNN models and NAS approaches in terms of effectiveness and efficiency. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 46197f6e-ff70-47e9-a583-358d2970747cCited by top-tier papers27
- Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free DataXin Zheng, Miao Zhang, Chunyang Chen, Quoc Viet Hung Nguyen et al.NeurIPS 2023 · 115 citations
- A Bi-Level Framework for Learning to Solve Combinatorial Optimization on GraphsRunzhong Wang, Zhigang Hua, Gan Liu, Jiayi Zhang et al.NeurIPS 2021 · 64 citations
- DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural NetworksYuhui Ding, Quanming Yao, Huan Zhao, Tong ZhangKDD 2021 · 63 citations
- Designing the Topology of Graph Neural Networks: A Novel Feature Fusion PerspectiveLanning Wei, Huan Zhao, Zhiqiang HeWWW 2022 · 51 citations
- AutoGEL: An Automated Graph Neural Network with Explicit Link InformationZhili Wang, Shimin Di, Lei ChenNeurIPS 2021 · 46 citations
Builds on10
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- GraphSAINT: Graph Sampling Based Inductive Learning MethodHanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan et al.ICLR 2020 · 1,155 citations
Related papers
- Rethinking Graph Neural Architecture Search From Message-PassingShaofei Cai, Liang Li, Jincan Deng, Beichen Zhang et al.CVPR 2021
- PSP: Progressive Space Pruning for Efficient Graph Neural Architecture SearchGuanghui Zhu, Wenjie Wang, Zhuoer Xu, Feng Cheng et al.ICDE 2022 · 5 citations
- Graph Differentiable Architecture Search with Structure LearningYijian Qin, Xin Wang, Zeyang Zhang, Wenwu ZhuNeurIPS 2021 · 52 citations
- Deep and Flexible Graph Neural Architecture SearchWentao Zhang, Zheyu Lin, Yu Shen, Yang Li et al.ICML 2022 · 5 citations
- Customizing Graph Neural Network for CAD Assembly RecommendationFengqi Liang, Huan Zhao, Yuhan Quan, Wei Fang et al.KDD 2024 · 3 citations
