Semi-Supervised Graph Imbalanced Regression
Gang Liu, Tong Zhao, Eric Inae, Tengfei Luo, Meng Jiang
Abstract
Data imbalance is easily found in annotated data when the observations of certain continuous label values are difficult to collect for regression tasks. When they come to molecule and polymer property predictions, the annotated graph datasets are often small because labeling them requires expensive equipment and effort. To address the lack of examples of rare label values in graph regression tasks, we propose a semi-supervised framework to progressively balance training data and reduce model bias via self-training. The training data balance is achieved by (1) pseudo-labeling more graphs for under-represented labels with a novel regression confidence measurement and (2) augmenting graph examples in latent space for remaining rare labels after data balancing with pseudo-labels. The former is to identify quality examples from unlabeled data whose labels are confidently predicted and sample a subset of them with a reverse distribution from the imbalanced annotated data. The latter collaborates with the former to target a perfect balance using a novel label-anchored mixup algorithm. We perform experiments in seven regression tasks on graph datasets. Results demonstrate that the proposed framework significantly reduces the error of predicted graph properties, especially in under-represented label areas.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1d792c6d-62f0-4d5a-ad75-3fd80ae4b902Cited by top-tier papers5
- Graph Diffusion Transformers for Multi-Conditional Molecular GenerationGang Liu, Jiaxin Xu, Tengfei Luo, Meng JiangNeurIPS 2024 · 73 citations
- GraphPatcher: Mitigating Degree Bias for Graph Neural Networks via Test-time AugmentationMingxuan Ju, Tong Zhao, Wenhao Yu, Neil Shah et al.NeurIPS 2023 · 52 citations
- Data-Centric Learning from Unlabeled Graphs with Diffusion ModelGang Liu, Eric Inae, Tong Zhao, Jiaxin Xu et al.NeurIPS 2023 · 32 citations
- Learning Molecular Representation in a CellGang Liu, Srijit Seal, John Arevalo, Zhenwen Liang et al.ICLR 2025
- Multimodal Large Language Models for Inverse Molecular Design with Retrosynthetic PlanningGang Liu, Michael Sun, Wojciech Matusik, Meng Jiang et al.ICLR 2025
Builds on23
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 1,010 citations
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain et al.ICLR 2021 · 937 citations
- Deep Evidential RegressionAlexander Amini, Wilko Schwarting, Ava Soleimany, Daniela RusNeurIPS 2020 · 777 citations
Related papers
- Metropolis-Hastings Data Augmentation for Graph Neural NetworksHyeon-Jin Park, Seunghun Lee, Sihyeon Kim, Jinyoung Park et al.NeurIPS 2021 · 65 citations
- Semi-Supervised Clustering Framework for Fine-grained Scene Graph GenerationJiarui Yang, Chuan Wang, Jun Zhang, Shuyi Wu et al.AAAI 2025 · 2 citations
- Deep Insights into Noisy Pseudo Labeling on Graph DataBotao Wang, Jia Li, Yang Liu, Jiashun Cheng et al.NeurIPS 2023 · 24 citations
- ASGN: An Active Semi-supervised Graph Neural Network for Molecular Property PredictionZhongkai Hao, Chengqiang Lu, Zhenya Huang, Hao Wang et al.KDD 2020 · 112 citations
- Regularizing Graph Neural Networks via Consistency-Diversity Graph AugmentationsDeyu Bo, Binbin Hu, Xiao Wang, Zhiqiang Zhang et al.AAAI 2022 · 35 citations
