EMNLP Findings2024
OpenGraph: Towards Open Graph Foundation Models
Lianghao Xia, Ben Kao, Chao Huang
Abstract
Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving performance in tasks like link prediction and node classification. However, a key challenge remains: the difficulty of generalizing to unseen graph data with different properties. In this work, we propose a novel graph foundation model, called OpenGraph, to address this challenge. Our approach tackles several technical obstacles. Firstly, we enhance data augmentation using a large language model (LLM) to overcome data scarcity in real-world scenarios. Secondly, we introduce a unified graph tokenizer that enables the model to generalize effectively to diverse graph data, even when encountering unseen properties during training. Thirdly, our developed scalable graph transformer captures node-wise dependencies within the global topological context. Extensive experiments validate the effectiveness of our framework. By adapting OpenGraph to new graph characteristics and comprehending diverse graphs, our approach achieves remarkable zero-shot graph learning performance across various settings. We release the model implementation at https://github.com/HKUDS/OpenGraph.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 24 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers24
- GFM-RAG: Graph Foundation Model for Retrieval Augmented GenerationLinhao Luo, Zicheng Zhao, Reza Haffari, Dinh Phung et al.NeurIPS 2025 · 54 citations
- SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain AdaptationXingtong Yu, Zechuan Gong, Chang Zhou, Yuan Fang et al.WWW 2025 · 45 citations
- RiemannGFM: Learning a Graph Foundation Model from Riemannian GeometryLi Sun, Zhenhao Huang, Suyang Zhou, Qiqi Wan et al.WWW 2025 · 31 citations
- Towards Effective Federated Graph Foundation Model via Mitigating Knowledge EntanglementYinlin Zhu, Xunkai Li, Jishuo Jia, Miao Hu et al.NeurIPS 2025 · 17 citations
- GraphPFN: A Prior-Data Fitted Graph Foundation ModelDmitry Eremeev, Oleg Platonov, Gleb Bazhenov, Artem Babenko et al.ICML 2026 · 15 citations
Builds on26
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
- Traffic Flow Prediction via Spatial Temporal Graph Neural NetworkXiaoyang Wang, Yao Ma, Yiqi Wang, Wei Jin et al.WWW 2020 · 644 citations
Related papers
- GraphGPT: Graph Instruction Tuning for Large Language ModelsJiabin Tang, Yuhao Yang, Wei Wei, Lei Shi et al.SIGIR 2024 · 182 citations
- RAGraph: A General Retrieval-Augmented Graph Learning FrameworkXinke Jiang, Rihong Qiu, Yongxin Xu, Wentao Zhang et al.NeurIPS 2024 · 42 citations
- Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-TreesZehong Wang, Zheyuan Zhang, Tianyi Ma, Nitesh V. Chawla et al.ICML 2025
- UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed GraphsYufei He, Yuan Sui, Xiaoxin He, Bryan HooiKDD 2025 · 8 citations
- BridgeGLM: Bridging Graph and Language Spaces for Domain GeneralizationJiaxing Qi, Yifan Xu, Zhifei Yang, Ruifei Ma et al.ACM MM 2025 · 1 citation
