Adaptive Graph Encoder for Attributed Graph Embedding
Ganqu Cui, Jie Zhou, Cheng Yang, Zhiyuan Liu
Abstract
Attributed graph embedding, which learns vector representations from graph topology and node features, is a challenging task for graph analysis. Recently, methods based on graph convolutional networks (GCNs) have made great progress on this task. However, existing GCN-based methods have three major drawbacks. Firstly, our experiments indicate that the entanglement of graph convolutional filters and weight matrices will harm both the performance and robustness. Secondly, we show that graph convolutional filters in these methods reveal to be special cases of generalized Laplacian smoothing filters, but they do not preserve optimal low-pass characteristics. Finally, the training objectives of existing algorithms are usually recovering the adjacency matrix or feature matrix, which are not always consistent with real-world applications. To address these issues, we propose Adaptive Graph Encoder (AGE), a novel attributed graph embedding framework. AGE consists of two modules: (1) To better alleviate the high-frequency noises in the node features, AGE first applies a carefully-designed Laplacian smoothing filter. (2) AGE employs an adaptive encoder that iteratively strengthens the filtered features for better node embeddings. We conduct experiments using four public benchmark datasets to validate AGE on node clustering and link prediction tasks. Experimental results show that AGE consistently outperforms state-of-the-art graph embedding methods considerably on these tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e97ccaeb-76d1-4c79-9721-7da001484d01Cited by top-tier papers47
- Beyond Low-frequency Information in Graph Convolutional NetworksDeyu Bo, Xiao Wang, Chuan Shi, Huawei ShenAAAI 2021 · 773 citations
- GraphMAE: Self-Supervised Masked Graph AutoencodersZhenyu Hou, Xiao Liu, Yukuo Cen, Yuxiao Dong et al.KDD 2022 · 533 citations
- GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph LearnerZhenyu Hou, Yufei He, Yukuo Cen, Xiao Liu et al.WWW 2023 · 183 citations
- Hard Sample Aware Network for Contrastive Deep Graph ClusteringYue Liu, Xihong Yang, Sihang Zhou, Xinwang Liu et al.AAAI 2023 · 175 citations
- Cluster-Guided Contrastive Graph Clustering NetworkXihong Yang, Yue Liu, Sihang Zhou, Siwei Wang et al.AAAI 2023 · 169 citations
Builds on1
Related papers
- Homophily-Related: Adaptive Hybrid Graph Filter for Multi-View Graph ClusteringZichen Wen, Yawen Ling, Yazhou Ren, Tianyi Wu et al.AAAI 2024 · 24 citations
- A Generic Edge-Empowered Graph Convolutional Network via Node-Edge Mutual EnhancementPengyang Wang, Jiaping Gui, Zhengzhang Chen, Junghwan Rhee et al.WWW 2020 · 10 citations
- Cross-Space Adaptive Filter: Integrating Graph Topology and Node Attributes for Alleviating the Over-smoothing ProblemChen Huang, Haoyang Li, Yifan Zhang, Wenqiang Lei et al.WWW 2024 · 10 citations
- HC-GAE: The Hierarchical Cluster-based Graph Auto-Encoder for Graph Representation LearningLu Bai, Zhuo Xu, Lixin Cui, Ming Li et al.NeurIPS 2024 · 13 citations
- NAFS: A Simple yet Tough-to-beat Baseline for Graph Representation LearningWentao Zhang, Zeang Sheng, Mingyu Yang, Yang Li et al.ICML 2022 · 24 citations
