PSP: Progressive Space Pruning for Efficient Graph Neural Architecture Search
Guanghui Zhu, Wenjie Wang, Zhuoer Xu, Feng Cheng, Mengchuan Qiu, Chunfeng Yuan, Yihua Huang
Abstract
Recently, graph neural network (GNN) has achieved great success in many graph learning tasks such as node classifi-cation and graph classification. However, there is no single GNN architecture that can fit different graph datasets. Designing an effective GNN for a specific graph dataset requires considerable expert experience and huge computational costs. Inspired by the success of neural architecture search (NAS), searching the GNN architectures automatically has attracted more and more attention. Motivated by the fact that the search space plays a critical role in the NAS, we propose a novel and effective graph neural architecture search method called PSP from the perspective of search space design in this paper. We first propose an expressive search space composed of multiple cells. Instead of searching the entire architecture, we focus on searching the architecture of the cell. Then, we propose a progressive space pruning-based algorithm to search the architectures efficiently. Moreover, the data-specific search spaces and architectures ob-tained by PSP can be transferred to new graph datasets based on meta-learning. Extensive experimental results on different types of graph datasets reveal that PSP outperforms the state-of-the-art handcrafted architectures and the existing NAS methods in terms of effectiveness and efficiency.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 17a86826-65b3-4d00-bc81-e40ce02d9f1bCited by top-tier papers5
- Large-Scale Graph Neural Architecture SearchChaoyu Guan, Xin Wang, Hong Chen, Ziwei Zhang et al.ICML 2022 · 27 citations
- Operation-Level Early Stopping for Robustifying Differentiable NASShen Jiang, Zipeng Ji, Guanghui Zhu, Chunfeng Yuan et al.NeurIPS 2023 · 19 citations
- AutoAC: Towards Automated Attribute Completion for Heterogeneous Graph Neural NetworkGuanghui Zhu, Zhennan Zhu, Wenjie Wang, Zhuoer Xu et al.ICDE 2023 · 14 citations
- Shapley Value Estimation based on Differential MatrixJunyuan Pang, Jian Pei, Haocheng Xia, Xiang Li et al.SIGMOD 2025 · 2 citations
- RZ-NAS: Enhancing LLM-guided Neural Architecture Search via Reflective Zero-Cost StrategyZipeng Ji, Guanghui Zhu, Chunfeng Yuan, Yihua HuangICML 2025
Related papers
- Rethinking Graph Neural Architecture Search From Message-PassingShaofei Cai, Liang Li, Jincan Deng, Beichen Zhang et al.CVPR 2021
- Deep and Flexible Graph Neural Architecture SearchWentao Zhang, Zheyu Lin, Yu Shen, Yang Li et al.ICML 2022 · 5 citations
- Graph Differentiable Architecture Search with Structure LearningYijian Qin, Xin Wang, Zeyang Zhang, Wenwu ZhuNeurIPS 2021 · 52 citations
- Search to aggregate neighborhood for graph neural networkHuan Zhao, Quanming Yao, Weiwei TuICDE 2021 · 75 citations
- Auto-HeG: Automated Graph Neural Network on Heterophilic GraphsXin Zheng, Miao Zhang, Chunyang Chen, Qin Zhang et al.WWW 2023 · 46 citations
