Toward Effective Digraph Representation Learning: A Magnetic Adaptive Propagation based Approach
Xunkai Li, Daohan Su, Zhengyu Wu, Guang Zeng, Hongchao Qin, Rong-Hua Li, Guoren Wang
Abstract
The 𝑞-parameterized magnetic Laplacian serves as the foundation of directed graph (digraph) convolution, enabling this kind of digraph neural network (MagDG) to encode node features and structural insights by complex-domain message passing. As a generalization of undirected methods, MagDG shows superior capability in modeling intricate web-scale topology. Despite the great success achieved by existing MagDGs, limitations still exist: (1) Hand-crafted 𝑞: The performance of MagDGs depends on selecting an appropriate 𝑞parameter to construct suitable graph propagation equations in the complex domain. This parameter tuning, driven by downstream tasks, limits model flexibility and significantly increases manual effort. (2) Coarse Message Passing: Most approaches treat all nodes with the same complex-domain propagation and aggregation rules, neglecting their unique digraph contexts. This oversight results in sub-optimal performance. To address the above issues, we propose two key techniques: (1) MAP is crafted to be a plug-and-play complex-domain propagation optimization strategy in the context of digraph learning, enabling seamless integration into any MagDG to improve predictions while enjoying high running efficiency. (2) MAP++ is a new digraph learning framework, further incorporating a learnable mechanism to achieve adaptively edge-wise propagation and node-wise aggregation in the complex domain for better performance. Extensive experiments on 12 datasets demonstrate that MAP enjoys flexibility for it can be incorporated with any MagDG, and scalability as it can deal with web-scale digraphs. MAP++ achieves SOTA predictive performance on 4 different downstream tasks. CCS Concepts • Computing methodologies → Semi-supervised learning settings; Neural networks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5d6629d9-a5e3-4f3e-a5ed-36e36a1443caCited by top-tier papers1
Ask how each one uses itBuilds on24
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 Ā· 3,935 citations
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 Ā· 1,910 citations
- How Attentive are Graph Attention Networks?Shaked Brody, Uri Alon, Eran YahavICLR 2022 Ā· 1,717 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 Ā· 1,445 citations
- Rumor Detection on Social Media with Bi-Directional Graph Convolutional NetworksTian Bian, Xi Xiao, Tingyang Xu, Peilin Zhao et al.AAAI 2020 Ā· 773 citations
Related papers
- LightDiC: A Simple yet Effective Approach for Large-scale Digraph Representation LearningXunkai Li, Meihao Liao, Zhengyu Wu, Daohan Su et al.VLDB 2024 Ā· 13 citations
- MagNet: A Neural Network for Directed GraphsXitong Zhang, Yixuan He, Nathan Brugnone, Michael Perlmutter et al.NeurIPS 2021 Ā· 223 citations
- SigMaNet: One Laplacian to Rule Them AllStefano Fiorini, Stefano Coniglio, Michele Ciavotta, Enza MessinaAAAI 2023 Ā· 35 citations
- DUPLEX: Dual GAT for Complex Embedding of Directed GraphsZhaoru Ke, Hang Yu, Jianguo Li, Haipeng ZhangICML 2024 Ā· 13 citations
- Digraph Inception Convolutional NetworksZekun Tong, Yuxuan Liang, Changsheng Sun, Xinke Li et al.NeurIPS 2020 Ā· 132 citations
