Lune

ICML2025Top-tier venue

Zero-Shot Generalization of GNNs over Distinct Attribute Domains

Yangyi Shen, Jincheng Zhou, Beatrice Bevilacqua, Joshua Robinson, Charilaos I. Kanatsoulis, Jure Leskovec, Bruno Ribeiro

Abstract

Traditional Graph Neural Networks (GNNs) cannot generalize to new graphs with node attributes different from the training ones, making zero-shot generalization across different node attribute domains an open challenge in graph machine learning. In this paper, we propose STAGE, which encodes statistical dependencies between attributes rather than individual attribute values, which may differ in test graphs. By assuming these dependencies remain invariant under changes in node attributes, STAGE achieves provable generalization guarantees for a family of domain shifts. Empirically, STAGE demonstrates strong zero-shot performance on medium-sized datasets: when trained on multiple graph datasets with different attribute spaces (varying in types and number) and evaluated on graphs with entirely new attributes, STAGE achieves a relative improvement in Hits@1 between 40% to 103% in link prediction and a 10% improvement in node classification compared to state-of-the-art baselines.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 3 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers3

  1. Generalization of Graph Neural Networks Is Robust to Model MismatchZhiyang Wang, Juan Cerviño, Alejandro RibeiroAAAI 2025 · 5 citations
  2. Bridging Input Feature Spaces Towards Graph Foundation ModelsMoshe Eliasof, Krishna Sri Ipsit Mantri, Beatrice Bevilacqua, Bruno Ribeiro et al.ICLR 2026 · 4 citations
  3. Holographic Node Representations: Pre-training Task-Agnostic Node EmbeddingsBeatrice Bevilacqua, Joshua Robinson, Jure Leskovec, Bruno RibeiroICLR 2025

Builds on16

  1. Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
  2. Large Language Models Are Zero-Shot Time Series ForecastersNate Gruver, Marc Finzi, Shikai Qiu, Andrew Gordon WilsonNeurIPS 2023 · 898 citations
  3. A Fine-Grained Analysis on Distribution ShiftOlivia Wiles, Sven Gowal, Florian Stimberg, Sylvestre-Alvise Rebuffi et al.ICLR 2022 · 258 citations
  4. One For All: Towards Training One Graph Model For All Classification TasksHao Liu, Jiarui Feng, Lecheng Kong, Ningyue Liang et al.ICLR 2024 · 253 citations
  5. What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao et al.ICML 2022 · 228 citations

Related papers

  1. OpenGraph: Towards Open Graph Foundation ModelsLianghao Xia, Ben Kao, Chao HuangEMNLP Findings 2024 · 18 citations
  2. Equivariance Everywhere All At Once: A Recipe for Graph Foundation ModelsBen Finkelshtein, Ismail Ilkan Ceylan, Michael M. Bronstein, Ron LevieNeurIPS 2025 · 21 citations
  3. LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token EmbeddingsDuo Wang, Yuan Zuo, Fengzhi Li, Junjie WuNeurIPS 2024 · 99 citations
  4. Graph Knows Unknowns: Reformulate Zero-Shot Learning as Sample-Level Graph RecognitionJingcai Guo, Song Guo, Qihua Zhou, Ziming Liu et al.AAAI 2023 · 42 citations
  5. Graph Out-of-Distribution Generalization via Causal InterventionQitian Wu, Fan Nie, Chenxiao Yang, Tianyi Bao et al.WWW 2024 · 58 citations
Dusk over the sea between two cliffs drawn in fine vertical lines