Zero-Shot Generalization of GNNs over Distinct Attribute Domains
Yangyi Shen, Jincheng Zhou, Beatrice Bevilacqua, Joshua Robinson, Charilaos I. Kanatsoulis, Jure Leskovec, Bruno Ribeiro
摘要
Traditional Graph Neural Networks (GNNs) cannot generalize to new graphs with node attributes different from the training ones, making zero-shot generalization across different node attribute domains an open challenge in graph machine learning. In this paper, we propose STAGE, which encodes statistical dependencies between attributes rather than individual attribute values, which may differ in test graphs. By assuming these dependencies remain invariant under changes in node attributes, STAGE achieves provable generalization guarantees for a family of domain shifts. Empirically, STAGE demonstrates strong zero-shot performance on medium-sized datasets: when trained on multiple graph datasets with different attribute spaces (varying in types and number) and evaluated on graphs with entirely new attributes, STAGE achieves a relative improvement in Hits@1 between 40% to 103% in link prediction and a 10% improvement in node classification compared to state-of-the-art baselines.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
引用它的顶会 Paper3
- Generalization of Graph Neural Networks Is Robust to Model MismatchZhiyang Wang, Juan Cerviño, Alejandro RibeiroAAAI 2025 · 5 次引用
- Bridging Input Feature Spaces Towards Graph Foundation ModelsMoshe Eliasof, Krishna Sri Ipsit Mantri, Beatrice Bevilacqua, Bruno Ribeiro 等ICLR 2026 · 4 次引用
- Holographic Node Representations: Pre-training Task-Agnostic Node EmbeddingsBeatrice Bevilacqua, Joshua Robinson, Jure Leskovec, Bruno RibeiroICLR 2025
它引用的 Paper16
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik 等ICLR 2020 · 1,744 次引用
- Large Language Models Are Zero-Shot Time Series ForecastersNate Gruver, Marc Finzi, Shikai Qiu, Andrew Gordon WilsonNeurIPS 2023 · 898 次引用
- A Fine-Grained Analysis on Distribution ShiftOlivia Wiles, Sven Gowal, Florian Stimberg, Sylvestre-Alvise Rebuffi 等ICLR 2022 · 258 次引用
- One For All: Towards Training One Graph Model For All Classification TasksHao Liu, Jiarui Feng, Lecheng Kong, Ningyue Liang 等ICLR 2024 · 253 次引用
- What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao 等ICML 2022 · 228 次引用
相关 Paper
- OpenGraph: Towards Open Graph Foundation ModelsLianghao Xia, Ben Kao, Chao HuangEMNLP Findings 2024 · 18 次引用
- Equivariance Everywhere All At Once: A Recipe for Graph Foundation ModelsBen Finkelshtein, Ismail Ilkan Ceylan, Michael M. Bronstein, Ron LevieNeurIPS 2025 · 21 次引用
- LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token EmbeddingsDuo Wang, Yuan Zuo, Fengzhi Li, Junjie WuNeurIPS 2024 · 99 次引用
- Graph Knows Unknowns: Reformulate Zero-Shot Learning as Sample-Level Graph RecognitionJingcai Guo, Song Guo, Qihua Zhou, Ziming Liu 等AAAI 2023 · 42 次引用
- Graph Out-of-Distribution Generalization via Causal InterventionQitian Wu, Fan Nie, Chenxiao Yang, Tianyi Bao 等WWW 2024 · 58 次引用
