Unsupervised Neighborhood Propagation Kernel Layers for Semi-supervised Node Classification
Sonny Achten, Francesco Tonin, Panagiotis Patrinos, Johan A. K. Suykens
Abstract
We present a deep Graph Convolutional Kernel Machine (GCKM) for semi-supervised node classification in graphs. The method is built of two main types of blocks: (i) We introduce unsupervised kernel machine layers propagating the node features in a one-hop neighborhood, using implicit node feature mappings. (ii) We specify a semi-supervised classification kernel machine through the lens of the Fenchel-Young inequality. We derive an effective initialization scheme and efficient end-to-end training algorithm in the dual variables for the full architecture. The main idea underlying GCKM is that, because of the unsupervised core, the final model can achieve higher performance in semi-supervised node classification when few labels are available for training. Experimental results demonstrate the effectiveness of the proposed framework. Contributions We introduce a deep Graph Convolutional Kernel Machine (GCKM) for node classification made of multiple shallow layers with non-parametric aggregation functions. Our main contributions are the following. • We propose an architecture consisting of multiple unsu-
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0729bd32-989d-4a7f-b61b-29869c5c44f3Builds on8
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple MethodsDerek Lim, Felix Hohne, Xiuyu Li, Sijia Linda Huang et al.NeurIPS 2021 · 534 citations
- BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein ApproximationMingguo He, Zhewei Wei, Zengfeng Huang, Hongteng XuNeurIPS 2021 · 378 citations
- Convolutional Neural Networks on Graphs with Chebyshev Approximation, RevisitedMingguo He, Zhewei Wei, Ji-Rong WenNeurIPS 2022 · 220 citations
- Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley TransformJun Li, Fuxin Li, Sinisa TodorovicICLR 2020 · 139 citations
Related papers
- Graph Convolutional Kernel Machine versus Graph Convolutional NetworksZhihao Wu, Zhao Zhang, Jicong FanNeurIPS 2023 · 41 citations
- Convolutional Kernel Networks for Graph-Structured DataDexiong Chen, Laurent Jacob, Julien MairalICML 2020 · 65 citations
- MMD Graph Kernel: Effective Metric Learning for Graphs via Maximum Mean DiscrepancyYan Sun, Jicong FanICLR 2024 · 17 citations
- Collaborative Graph Convolutional Networks: Unsupervised Learning Meets Semi-Supervised LearningBinyuan Hui, Pengfei Zhu, Qinghua HuAAAI 2020 · 67 citations
- Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology SamplingHongkang Li, Meng Wang, Sijia Liu, Pin-Yu Chen et al.ICML 2022 · 34 citations
