Feature-Centric Unsupervised Node Representation Learning Without Homophily Assumption
Sunwoo Kim, Soo Yong Lee, Kyungho Kim, Hyunjin Hwang, Jaemin Yoo, Kijung Shin
Abstract
Unsupervised node representation learning aims to obtain meaningful node embeddings without relying on node labels. To achieve this, graph convolution, which aggregates information from neighboring nodes, is commonly employed to encode node features and graph topology. However, excessive reliance on graph convolution can be suboptimal—especially in non-homophilic graphs—since it may yield unduly similar embeddings for nodes that differ in their features or topological properties. As a result, adjusting the degree of graph convolution usage has been actively explored in supervised learning settings, whereas such approaches remain underexplored in unsupervised scenarios. To tackle this, we propose FUEL, which adaptively learns the adequate degree of graph convolution usage by aiming to enhance intra-class similarity and inter-class separability in the embedding space. Since classes are unknown, FUEL leverages node features to identify node clusters and treats these clusters as proxies for classes. Through extensive experiments using 15 baseline methods and 14 benchmark datasets, we demonstrate the effectiveness of FUEL in downstream tasks, achieving state-of-the-art performance across graphs with diverse levels of homophily.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 341c8bc2-d946-4e7f-8270-84d45553c285Builds on17
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann et al.NeurIPS 2020 · 1,490 citations
- Self-labelling via simultaneous clustering and representation learningYuki Markus Asano, Christian Rupprecht, Andrea VedaldiICLR 2020 · 873 citations
- Revisiting Heterophily For Graph Neural NetworksSitao Luan, Chenqing Hua, Qincheng Lu, Jiaqi Zhu et al.NeurIPS 2022 · 351 citations
Related papers
- Powerful Graph Convolutional Networks with Adaptive Propagation Mechanism for Homophily and HeterophilyTao Wang, Di Jin, Rui Wang, Dongxiao He et al.AAAI 2022 · 126 citations
- Homophily-Related: Adaptive Hybrid Graph Filter for Multi-View Graph ClusteringZichen Wen, Yawen Ling, Yazhou Ren, Tianyi Wu et al.AAAI 2024 · 24 citations
- Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily DiscriminatingYixin Liu, Yizhen Zheng, Daokun Zhang, Vincent C. S. Lee et al.AAAI 2023 · 116 citations
- Normalize Then Propagate: Efficient Homophilous Regularization for Few-Shot Semi-Supervised Node ClassificationBaoming Zhang, Mingcai Chen, Jianqing Song, Shuangjie Li et al.AAAI 2025 · 1 citation
- Simplified Graph Convolution with HeterophilySudhanshu Chanpuriya, Cameron MuscoNeurIPS 2022 · 42 citations
