From Trainable Negative Depth to Edge Heterophily in Graphs
Yuchen Yan, Yuzhong Chen, Huiyuan Chen, Minghua Xu, Mahashweta Das, Hao Yang, Hanghang Tong
Abstract
Finding the proper depth d of a graph convolutional network (GCN) that provides strong representation ability has drawn significant attention, yet nonetheless largely remains an open problem for the graph learning community. Although noteworthy progress has been made, the depth or the number of layers of a corresponding GCN is realized by a series of graph convolution operations, which naturally makes d a positive integer ( d ∈ N + ). An interesting question is whether breaking the constraint of N + by making d a real number ( d ∈ R ) can bring new insights into graph learning mechanisms. In this work, by redefining GCN’s depth d as a trainable parameter continuously adjustable within ( −∞ , + ∞ ) , we open a new door of controlling its signal processing capability to model graph homophily/heterophily (nodes with similar/dissimilar labels/attributes tend to be inter-connected). A simple and powerful GCN model T E DGCN, is proposed to retain the simplicity of GCN and meanwhile automatically search for the optimal d without the prior knowledge regarding whether the input graph is homophilic or heterophilic. Negative-valued d intrinsically enables high-pass frequency filtering functionality via augmented topology for graph heterophily. Extensive experiments demonstrate the superiority of T E DGCN on node classification tasks for a variety of homophilic and heterophilic graphs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 19191754-407d-47b9-8c5d-479e34faa02cCited by top-tier papers13
- VCR-Graphormer: A Mini-batch Graph Transformer via Virtual ConnectionsDongqi Fu, Zhigang Hua, Yan Xie, Jin Fang et al.ICLR 2024 · 47 citations
- Class-Imbalanced Graph Learning without Class RebalancingZhining Liu, Ruizhong Qiu, Zhichen Zeng, Hyunsik Yoo et al.ICML 2024 · 35 citations
- PaCEr: Network Embedding From Positional to StructuralYuchen Yan, Yongyi Hu, Qinghai Zhou, Lihui Liu et al.WWW 2024 · 33 citations
- Graph Mixup on Approximate Gromov-Wasserstein GeodesicsZhichen Zeng, Ruizhong Qiu, Zhe Xu, Zhining Liu et al.ICML 2024 · 30 citations
- SLOG: An Inductive Spectral Graph Neural Network Beyond Polynomial FilterHaobo Xu, Yuchen Yan, Dingsu Wang, Zhe Xu et al.ICML 2024 · 24 citations
Builds on33
- DeepGCNs: Can GCNs Go As Deep As CNNs?Guohao Li, Matthias Müller, Ali K. Thabet, Bernard GhanemICCV 2019 · 1,586 citations
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann et al.NeurIPS 2020 · 1,490 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Beyond Low-frequency Information in Graph Convolutional NetworksDeyu Bo, Xiao Wang, Chuan Shi, Huawei ShenAAAI 2021 · 773 citations
- PairNorm: Tackling Oversmoothing in GNNsLingxiao Zhao, Leman AkogluICLR 2020 · 590 citations
Related papers
- Powerful Graph Convolutional Networks with Adaptive Propagation Mechanism for Homophily and HeterophilyTao Wang, Di Jin, Rui Wang, Dongxiao He et al.AAAI 2022 · 126 citations
- Block Modeling-Guided Graph Convolutional Neural NetworksDongxiao He, Chundong Liang, Huixin Liu, Mingxiang Wen et al.AAAI 2022 · 85 citations
- Beyond Homophily: Reconstructing Structure for Graph-agnostic ClusteringErlin Pan, Zhao KangICML 2023 · 67 citations
- PC-Conv: Unifying Homophily and Heterophily with Two-Fold FilteringBingheng Li, Erlin Pan, Zhao KangAAAI 2024 · 67 citations
- GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and HeterophilyLun Du, Xiaozhou Shi, Qiang Fu, Xiaojun Ma et al.WWW 2022 · 155 citations
