Implicit Subgraph Neural Network
Yongjian Zhong, Liao Zhu, Hieu Vu, Bijaya Adhikari
Abstract
Subgraph neural networks have recently gained prominence for various subgraph-level predictive tasks. However, existing methods either 1) apply simple standard pooling over graph convolutional networks, failing to capture essential subgraph properties, or 2) rely on rigid subgraph definitions, leading to suboptimal performance. Moreover, these approaches fail to model longrange dependencies both between and within subgraphs-a critical limitation, as many realworld networks contain subgraphs of varying sizes and connectivity patterns. In this paper, we propose a novel implicit subgraph neural network, the first of its kind, designed to capture dependencies across subgraphs. Our approach also integrates label-aware subgraph-level information. We formulate implicit subgraph learning as a bilevel optimization problem and develop a provably convergent algorithm that requires fewer gradient estimations than standard bilevel optimization methods. We evaluate our approach on real-world networks against state-ofthe-art baselines, demonstrating its effectiveness and superiority. Our code is avaliable https: //github.com/MLonGraph/ISNN
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0213ece0-baf1-47a8-ae20-83974cef6db4Cited by top-tier papers1
Ask how each one uses itBuilds on14
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation LearningMuhan Zhang, Pan Li, Yinglong Xia, Kai Wang et al.NeurIPS 2021 · 255 citations
- Implicit Graph Neural NetworksFangda Gu, Heng Chang, Wenwu Zhu, Somayeh Sojoudi et al.NeurIPS 2020 · 188 citations
- Subgraph Neural NetworksEmily Alsentzer, Samuel G. Finlayson, Michelle M. Li, Marinka ZitnikNeurIPS 2020 · 185 citations
- Towards Gradient-based Bilevel Optimization with Non-convex Followers and BeyondRisheng Liu, Yaohua Liu, Shangzhi Zeng, Jin ZhangNeurIPS 2021 · 111 citations
Related papers
- Efficient and Effective Implicit Dynamic Graph Neural NetworkYongjian Zhong, Hieu Vu, Tianbao Yang, Bijaya AdhikariKDD 2024 · 7 citations
- MGNNI: Multiscale Graph Neural Networks with Implicit LayersJuncheng Liu, Bryan Hooi, Kenji Kawaguchi, Xiaokui XiaoNeurIPS 2022 · 36 citations
- Scalable and Effective Implicit Graph Neural Networks on Large GraphsJuncheng Liu, Bryan Hooi, Kenji Kawaguchi, Yiwei Wang et al.ICLR 2024 · 13 citations
- ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph RepresentationsEkagra Ranjan, Soumya Sanyal, Partha P. TalukdarAAAI 2020 · 400 citations
- GLASS: GNN with Labeling Tricks for Subgraph Representation LearningXiyuan Wang, Muhan ZhangICLR 2022 · 38 citations
