Posterior Label Smoothing for Node Classification
Jaeseung Heo, MoonJeong Park, Dongwoo Kim
Abstract
Label smoothing is a widely studied regularization technique in machine learning. However, its potential for node classification in graph-structured data, spanning homophilic to heterophilic graphs, remains largely unexplored. We introduce posterior label smoothing, a novel method for transductive node classification that derives soft labels from a posterior distribution conditioned on neighborhood labels. The likelihood and prior distributions are estimated from the global statistics of the graph structure, allowing our approach to adapt naturally to various graph properties. We evaluate our method on 10 benchmark datasets using eight baseline models, demonstrating consistent improvements in classification accuracy. The following analysis demonstrates that soft labels mitigate overfitting during training, leading to better generalization performance, and that pseudo-labeling effectively refines the global label statistics of the graph.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7445db9c-fdf7-46c1-bcfd-0026c2cb6077Builds on13
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- Self-Supervised Graph Transformer on Large-Scale Molecular DataYu Rong, Yatao Bian, Tingyang Xu, Weiyang Xie et al.NeurIPS 2020 · 1,113 citations
- Does label smoothing mitigate label noise?Michal Lukasik, Srinadh Bhojanapalli, Aditya Krishna Menon, Sanjiv KumarICML 2020 · 411 citations
- BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein ApproximationMingguo He, Zhewei Wei, Zengfeng Huang, Hongteng XuNeurIPS 2021 · 378 citations
Related papers
- Node Dependent Local Smoothing for Scalable Graph LearningWentao Zhang, Mingyu Yang, Zeang Sheng, Yang Li et al.NeurIPS 2021 · 87 citations
- Curriculum-Enhanced Residual Soft An-Isotropic Normalization for Over-Smoothness in Deep GNNsJin Li, Qirong Zhang, Shuling Xu, Xinlong Chen et al.AAAI 2024 · 3 citations
- Adjusted Count Quantification Learning on GraphsClemens Damke, Eyke HüllermeierNeurIPS 2025 · 1 citation
- Learning Posterior Predictive Distributions for Node Classification from Synthetic Graph PriorsJeongwhan Choi, Jongwoo Kim, Woosung Kang, Noseong ParkICLR 2026 · 15 citations
- Deep Graph Neural Networks via Posteriori-Sampling-based Node-Adaptative Residual ModuleJingbo Zhou, Yixuan Du, Ruqiong Zhang, Jun Xia et al.NeurIPS 2024 · 6 citations
