RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation
Haonan Yuan, Qingyun Sun, Jiacheng Tao, Xingcheng Fu, Jianxin Li
Abstract
Graph Foundation Models (GFMs) have emerged as a frontier in graph learning, which are expected to deliver transferable representations across diverse tasks. However, GFMs remain constrained by in-memory bottlenecks: they attempt to encode knowledge into model parameters, which limits semantic capacity, introduces heavy lossy compression with conflicts, and entangles graph representation with the knowledge in ways that hinder efficient adaptation, undermining scalability and interpretability. In this work,we propose RAG-GFM, a Retrieval-Augmented Generation aided Graph Foundation Model that offloads knowledge from parameters and complements parameterized learning. To externalize graph knowledge, we build a dual-modal unified retrieval module, where a semantic store from prefix-structured text and a structural store from centrality-based motif. To preserve heterogeneous information, we design a dual-view alignment objective that contrasts both modalities to capture both content and relational patterns. To enable efficient downstream adaptation, we perform in-context augmentation to enrich supporting instances with retrieved texts and motifs as contextual evidence. Extensive experiments on five benchmark graph datasets demonstrate that RAG-GFM consistently outperforms 13 state-of-the-art baselines in both cross-domain node and graph classification, achieving superior effectiveness and efficiency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ad1690d8-b918-4a11-9f09-905180e4a42bCited by top-tier papers2
- Structure-Centric Graph Foundation Model via Geometric BasesXiaodong He, Haolan He, Ruiyi Fang, Ming Sun et al.ICML 2026 · 1 citation
- Generalizing Graph Foundation Models via Hyperbolic Retrieval-Augmented GenerationYifan Jin, Qirui Ji, Bin Qin, Jiangmeng Li et al.KDD 2026 · 1 citation
Builds on41
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Measuring and Relieving the Over-Smoothing Problem for Graph Neural Networks from the Topological ViewDeli Chen, Yankai Lin, Wei Li, Peng Li et al.AAAI 2020 · 1,353 citations
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 1,010 citations
Related papers
- RAG4GFM: Bridging Knowledge Gaps in Graph Foundation Models through Graph Retrieval Augmented GenerationXingliang Wang, Zemin Liu, Junxiao Han, Shuiguang DengNeurIPS 2025 · 6 citations
- GFM-RAG: Graph Foundation Model for Retrieval Augmented GenerationLinhao Luo, Zicheng Zhao, Reza Haffari, Dinh Phung et al.NeurIPS 2025 · 54 citations
- A Graph Foundation Model with Cross-Modal Alignment and Modality-Aware Expert Fusion for Multi-Modal GraphsDongxiao He, AnKang Yang, Jitao Zhao, Di JinICML 2026
- G-reasoner: Foundation Models for Unified Reasoning over Graph-structured KnowledgeLinhao Luo, Zicheng Zhao, Junnan Liu, Zhangchi Qiu et al.ICLR 2026 · 12 citations
- Enhanced Expert Merging for Mixture-of-Experts in Graph Foundation ModelsLei Liu, Xingyu Xia, Qianqian Xie, Ben Liu et al.NeurIPS 2025 · 4 citations
