Divergent Paths: Separating Homophilic and Heterophilic Learning for Enhanced Graph-level Representations
Han Lei, Jiaxing Xu, Xia Dong, Yiping Ke
Abstract
Graph Convolutional Networks (GCNs) are predominantly tailored for graphs displaying homophily, where similar nodes connect, but often fail on heterophilic graphs. The strategy of adopting distinct approaches to learn from homophilic and heterophilic components in node-level tasks has been widely discussed and proven effective both theoretically and experimentally. However, in graph-level tasks, research on this topic remains notably scarce. Addressing this gap, our research conducts an analysis on graphs with nodes' category ID available, distinguishing intra-category and inter-category components as embodiment of homophily and heterophily, respectively. We find while GCNs excel at extracting information within categories, they frequently capture noise from inter-category components. Consequently, it is crucial to employ distinct learning strategies for intra- and inter-category elements. To alleviate this problem, we separately learn the intra- and inter-category parts by a combination of an intra-category convolution (IntraNet) and an inter-category high-pass graph convolution (InterNet). Our IntraNet is supported by sophisticated graph preprocessing steps and a novel category-based graph readout function. For the InterNet, we utilize a high-pass filter to amplify the node disparities, enhancing the recognition of details in the high-frequency components. The proposed approach, DivGNN, combines the IntraNet and InterNet with a gated mechanism and substantially improves classification performance on graph-level tasks, surpassing traditional GNN baselines in effectiveness.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7a6eb896-00b5-4ee5-9907-323de220b031Cited by top-tier papers1
Ask how each one uses itBuilds on10
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann et al.NeurIPS 2020 · 1,490 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Beyond Low-frequency Information in Graph Convolutional NetworksDeyu Bo, Xiao Wang, Chuan Shi, Huawei ShenAAAI 2021 · 773 citations
- Graph Neural Networks with HeterophilyJiong Zhu, Ryan A. Rossi, Anup Rao, Tung Mai et al.AAAI 2021 · 393 citations
- Is Homophily a Necessity for Graph Neural Networks?Yao Ma, Xiaorui Liu, Neil Shah, Jiliang TangICLR 2022 · 295 citations
Related papers
- Node Classification Beyond Homophily: Towards a General SolutionZhe Xu, Yuzhong Chen, Qinghai Zhou, Yuhang Wu et al.KDD 2023 · 17 citations
- Beyond Homophily: Reconstructing Structure for Graph-agnostic ClusteringErlin Pan, Zhao KangICML 2023 · 67 citations
- AGS-GNN: Attribute-guided Sampling for Graph Neural NetworksSiddhartha Shankar Das, S. M. Ferdous, Mahantesh M. Halappanavar, Edoardo Serra et al.KDD 2024 · 3 citations
- HeroFilter: Adaptive Spectral Graph Filter for Varying Heterophilic RelationsShuaicheng Zhang, Haohui Wang, Junhong Lin, Xiaojie Guo et al.NeurIPS 2025 · 5 citations
- Block Modeling-Guided Graph Convolutional Neural NetworksDongxiao He, Chundong Liang, Huixin Liu, Mingxiang Wen et al.AAAI 2022 · 85 citations
