How Much Can Transfer? BRIDGE: Bounded Multi-Domain Graph Foundation Model with Generalization Guarantees
Haonan Yuan, Qingyun Sun, Junhua Shi, Xingcheng Fu, Bryan Hooi, Jianxin Li, Philip S. Yu
Abstract
Graph Foundation Models hold significant potential for advancing multi-domain graph learning, yet their full capabilities remain largely untapped. Existing works show promising task performance with the "pretrain-then-prompt" paradigm, which lacks theoretical foundations to understand why it works and how much knowledge can be transferred from source domains to the target. In this paper, we introduce BRIDGE, a Bounded gRaph foundatIon model pre-trained on multi-Domains with Generalization guarantEes. To learn discriminative source knowledge, we align multi-domain graph features with domain-invariant aligners during pre-training. Then, a lightweight Mixture of Experts (MoE) network is proposed to facilitate downstream prompting through self-supervised selective knowledge assembly and transfer. Further, to determine the maximum amount of transferable knowledge, we derive an optimizable generalization error upper bound from a graph spectral perspective given the Lipschitz continuity. Extensive experiments demonstrate the superiority of BRIDGE on both node and graph classification compared with 15 state-of-the-art baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 37adf987-b2c5-4511-8c9d-2889ff4fc5beCited by top-tier papers14
- GRAVER: Generative Graph Vocabularies for Robust Graph Foundation Models Fine-tuningHaonan Yuan, Qingyun Sun, Junhua Shi, Xingcheng Fu et al.NeurIPS 2025 · 17 citations
- Deeper with Riemannian Geometry: Overcoming Oversmoothing and Oversquashing for Graph Foundation ModelsLi Sun, Zhenhao Huang, Ming Zhang, Philip S. YuNeurIPS 2025 · 10 citations
- Multi-Domain Riemannian Graph Gluing for Building Graph Foundation ModelsLi Sun, Zhenhao Huang, Silei Chen, Lanxu Yang et al.ICLR 2026 · 5 citations
- Bridging Input Feature Spaces Towards Graph Foundation ModelsMoshe Eliasof, Krishna Sri Ipsit Mantri, Beatrice Bevilacqua, Bruno Ribeiro et al.ICLR 2026 · 4 citations
- SA²GFM: Enhancing Robust Graph Foundation Models with Structure-Aware Semantic AugmentationJunhua Shi, Qingyun Sun, Haonan Yuan, Xingcheng FuAAAI 2026 · 3 citations
Builds on47
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- Conditional Prompt Learning for Vision-Language ModelsKaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei LiuCVPR 2022 · 1,438 citations
- GraphSAINT: Graph Sampling Based Inductive Learning MethodHanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan et al.ICLR 2020 · 1,155 citations
Related papers
- Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology AlignmentShuo Wang, Bokui Wang, Zhixiang Shen, Boyan Deng et al.ICML 2025
- Out-of-Distribution Graph Models MergingYidi Wang, Ziyue Qiao, Jiawei Gu, Xubin Zheng et al.ICLR 2026
- MDGMIX: Boundary-Aware Subgraph Mixing for Multi-Domain Graph Pre-TrainingZiyu Zheng, Yaming Yang, Ziyu Guan, Wei Zhao et al.ICML 2026
- Graph Cross-Domain Continual Fine-Tuning via Orthogonal LoRA Routing with Contrastive Expert SpecializationQianyi Cai, Ziyue Qiao, Minghao Yang, Xiao Luo et al.WWW 2026
- Handling Feature Heterogeneity with Learnable Graph PatchesYifei Sun, Yang Yang, Xiao Feng, Zijun Wang et al.KDD 2025 · 1 citation
