Automated Loss function Search for Class-imbalanced Node Classification
Xinyu Guo, Kai Wu, Xiaoyu Zhang, Jing Liu
Abstract
Class-imbalanced node classification tasks are prevalent in real-world scenarios. Due to the uneven distribution of nodes across different classes, learning high-quality node representations remains a challenging endeavor. The engineering of loss functions has shown promising potential in addressing this issue. It involves the meticulous design of loss functions, utilizing information about the quantities of nodes in different categories and the network's topology to learn unbiased node representations. However, the design of these loss functions heavily relies on human expert knowledge and exhibits limited adaptability to specific target tasks. In this paper, we introduce a high-performance, flexible, and generalizable automated loss function search framework to tackle this challenge. Across 15 combinations of graph neural networks and datasets, our framework achieves a significant improvement in performance compared to state-of-the-art methods. Additionally, we observe that homophily in graph-structured data significantly contributes to the transferability of the proposed framework.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7fcb6308-92e1-4ba7-aec6-b0c9badb6b9fCited by top-tier papers1
Ask how each one uses itBuilds on16
- Balanced Meta-Softmax for Long-Tailed Visual RecognitionJiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma et al.NeurIPS 2020 · 861 citations
- AutoML-Zero: Evolving Machine Learning Algorithms From ScratchEsteban Real, Chen Liang, David R. So, Quoc V. LeICML 2020 · 265 citations
- GraphENS: Neighbor-Aware Ego Network Synthesis for Class-Imbalanced Node ClassificationJoonhyung Park, Jaeyun Song, Eunho YangICLR 2022 · 145 citations
- Topology-Imbalance Learning for Semi-Supervised Node ClassificationDeli Chen, Yankai Lin, Guangxiang Zhao, Xuancheng Ren et al.NeurIPS 2021 · 143 citations
- AM-LFS: AutoML for Loss Function SearchChuming Li, Xin Yuan, Chen Lin, Minghao Guo et al.ICCV 2019 · 75 citations
Related papers
- Automated Self-Supervised Learning for GraphsWei Jin, Xiaorui Liu, Xiangyu Zhao, Yao Ma et al.ICLR 2022 · 95 citations
- TAM: Topology-Aware Margin Loss for Class-Imbalanced Node ClassificationJaeyun Song, Joonhyung Park, Eunho YangICML 2022 · 90 citations
- Rethinking Semi-Supervised Imbalanced Node Classification from Bias-Variance DecompositionDivin Yan, Gengchen Wei, Chen Yang, Shengzhong Zhang et al.NeurIPS 2023 · 27 citations
- Hyperbolic Geometric Graph Representation Learning for Hierarchy-imbalance Node ClassificationXingcheng Fu, Yuecen Wei, Qingyun Sun, Haonan Yuan et al.WWW 2023 · 41 citations
- BIM: Improving Graph Neural Networks with Balanced Influence MaximizationWentao Zhang, Xinyi Gao, Ling Yang, Meng Cao et al.ICDE 2024 · 4 citations
