Empowering Graph Representation Learning with Test-Time Graph Transformation
Wei Jin, Tong Zhao, Jiayuan Ding, Yozen Liu, Jiliang Tang, Neil Shah
Abstract
As powerful tools for representation learning on graphs, graph neural networks (GNNs) have facilitated various applications from drug discovery to recommender systems. Nevertheless, the effectiveness of GNNs is immensely challenged by issues related to data quality, such as distribution shift, abnormal features and adversarial attacks. Recent efforts have been made on tackling these issues from a modeling perspective which requires additional cost of changing model architectures or re-training model parameters. In this work, we provide a data-centric view to tackle these issues and propose a graph transformation framework named GTRANS which adapts and refines graph data at test time to achieve better performance. We provide theoretical analysis on the design of the framework and discuss why adapting graph data works better than adapting the model. Extensive experiments have demonstrated the effectiveness of GTRANS on three distinct scenarios for eight benchmark datasets where suboptimal data is presented. Remarkably, GTRANS performs the best in most cases with improvements up to 2.8%, 8.2% and 3.8% over the best baselines on three experimental settings. Code is released at https://github.com/ChandlerBang/GTrans .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1f4e786e-e5eb-4fbf-81fc-a5846b436a67Cited by top-tier papers40
- Does Invariant Graph Learning via Environment Augmentation Learn Invariance?Yongqiang Chen, Yatao Bian, Kaiwen Zhou, Binghui Xie et al.NeurIPS 2023 · 71 citations
- Unleashing the Power of Graph Data Augmentation on Covariate Distribution ShiftYongduo Sui, Qitian Wu, Jiancan Wu, Qing Cui et al.NeurIPS 2023 · 63 citations
- Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?Haitao Mao, Zhikai Chen, Wei Jin, Haoyu Han et al.NeurIPS 2023 · 58 citations
- GraphPatcher: Mitigating Degree Bias for Graph Neural Networks via Test-time AugmentationMingxuan Ju, Tong Zhao, Wenhao Yu, Neil Shah et al.NeurIPS 2023 · 52 citations
- GraphMETRO: Mitigating Complex Graph Distribution Shifts via Mixture of Aligned ExpertsShirley Wu, Kaidi Cao, Bruno Ribeiro, James Y. Zou et al.NeurIPS 2024 · 27 citations
Builds on33
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Tent: Fully Test-Time Adaptation by Entropy MinimizationDequan Wang, Evan Shelhamer, Shaoteng Liu, Bruno A. Olshausen et al.ICLR 2021 · 1,731 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
Related papers
- Can Modifying Data Address Graph Domain Adaptation?Renhong Huang, Jiarong Xu, Xin Jiang, Ruichuan An et al.KDD 2024 · 1 citation
- Provably Robust Explainable Graph Neural Networks against Graph Perturbation AttacksJiate Li, Meng Pang, Yun Dong, Jinyuan Jia et al.ICLR 2025
- Test-Time Graph Neural Dataset Search With Generative ProjectionXin Zheng, Wei Huang, Chuan Zhou, Ming Li et al.ICML 2025
- Distributionally Robust Graph-based Recommendation SystemBohao Wang, Jiawei Chen, Changdong Li, Sheng Zhou et al.WWW 2024 · 42 citations
- Matcha: Mitigating Graph Structure Shifts with Test-Time AdaptationWenxuan Bao, Zhichen Zeng, Zhining Liu, Hanghang Tong et al.ICLR 2025
