Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning
Jiashun Cheng, Man Li, Jia Li, Fugee Tsung
摘要
Graph self-supervised learning (SSL) has been vastly employed to learn representations from unlabeled graphs. Existing methods can be roughly divided into predictive learning and contrastive learning, where the latter one attracts more research attention with better empirical performance. We argue that, however, predictive models weaponed with powerful decoder could achieve comparable or even better representation power than contrastive models. In this work, we propose a Wiener Graph Deconvolutional Network (WGDN), an augmentation-adaptive decoder empowered by graph wiener filter to perform information reconstruction. Theoretical analysis proves the superior reconstruction ability of graph wiener filter. Extensive experimental results on various datasets demonstrate the effectiveness of our approach.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper11
- All in One: Multi-Task Prompting for Graph Neural NetworksXiangguo Sun, Hong Cheng, Jia Li, Bo Liu 等KDD 2023 · 被引用 149 次
- LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token EmbeddingsDuo Wang, Yuan Zuo, Fengzhi Li, Junjie WuNeurIPS 2024 · 被引用 99 次
- Rethinking Graph Masked Autoencoders through Alignment and UniformityLiang Wang, Xiang Tao, Qiang Liu, Shu Wu 等AAAI 2024 · 被引用 40 次
- SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive BiasesYang Liu, Jiashun Cheng, Haihong Zhao, Tingyang Xu 等ICLR 2024 · 被引用 32 次
- ZeroG: Investigating Cross-dataset Zero-shot Transferability in GraphsYuhan Li, Peisong Wang, Zhixun Li, Jeffrey Xu Yu 等KDD 2024 · 被引用 19 次
它引用的顶会 Paper21
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong 等NeurIPS 2020 · 被引用 3,935 次
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen 等NeurIPS 2020 · 被引用 3,042 次
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik 等ICLR 2020 · 被引用 1,744 次
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu 等WWW 2021 · 被引用 1,415 次
相关 Paper
- Self-Supervised Representation Learning via Latent Graph PredictionYaochen Xie, Zhao Xu, Shuiwang JiICML 2022 · 被引用 43 次
- SeeGera: Self-supervised Semi-implicit Graph Variational Auto-encoders with MaskingXiang Li, Tiandi Ye, Caihua Shan, Dongsheng Li 等WWW 2023 · 被引用 46 次
- Graph Self-supervised Learning with Augmentation-aware Contrastive LearningDong Chen, Xiang Zhao, Wei Wang, Zhen Tan 等WWW 2023 · 被引用 17 次
- Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised LearningSheng Wan, Shirui Pan, Jian Yang, Chen GongAAAI 2021 · 被引用 162 次
- Graph Self-supervised Learning with Accurate Discrepancy LearningDongki Kim, Jinheon Baek, Sung Ju HwangNeurIPS 2022 · 被引用 46 次
