Lune

ICDE2020Top-tier venue

Self-paced Ensemble for Highly Imbalanced Massive Data Classification

Zhining Liu, Wei Cao, Zhifeng Gao, Jiang Bian, Hechang Chen, Yi Chang, Tie-Yan Liu

Abstract

Many real-world applications reveal difficulties in learning classifiers from imbalanced data. The rising big data era has been witnessing more classification tasks with large-scale but extremely imbalance and low-quality datasets. Most of existing learning methods suffer from poor performance or low computation efficiency under such a scenario. To tackle this problem, we conduct deep investigations into the nature of class imbalance, which reveals that not only the disproportion between classes, but also other difficulties embedded in the nature of data, especially, noises and class overlapping, prevent us from learning effective classifiers. Taking those factors into consideration, we propose a novel framework for imbalance classification that aims to generate a strong ensemble by self-paced harmonizing data hardness via under-sampling. Extensive experiments have shown that this new framework, while being very computationally efficient, can lead to robust performance even under highly overlapping classes and extremely skewed distribution. Note that, our methods can be easily adapted to most of existing learning methods (e.g., C4.5, SVM, GBDT and Neural Network) to boost their performance on imbalanced data.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

10 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • SLOG: An Inductive Spectral Graph Neural Network Beyond Polynomial Filter cites MESA: Boost Ensemble Imbalanced Learning with MEta-SAmpler
  • BadSampler: Harnessing the Power of Catastrophic Forgetting to Poison Byzantine-robust Federated Learning cites MESA: Boost Ensemble Imbalanced Learning with MEta-SAmpler
  • AIM: Attributing, Interpreting, Mitigating Data Unfairness cites MESA: Boost Ensemble Imbalanced Learning with MEta-SAmpler
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers10

  1. MESA: Boost Ensemble Imbalanced Learning with MEta-SAmplerZhining Liu, Pengfei Wei, Jing Jiang, Wei Cao et al.NeurIPS 2020 · 80 citations
  2. SLOG: An Inductive Spectral Graph Neural Network Beyond Polynomial FilterHaobo Xu, Yuchen Yan, Dingsu Wang, Zhe Xu et al.ICML 2024 · 24 citations
  3. BadSampler: Harnessing the Power of Catastrophic Forgetting to Poison Byzantine-robust Federated LearningYi Liu, Cong Wang, Xingliang YuanKDD 2024 · 5 citations
  4. AIM: Attributing, Interpreting, Mitigating Data UnfairnessZhining Liu, Ruizhong Qiu, Zhichen Zeng, Yada Zhu et al.KDD 2024 · 4 citations
  5. Rare Event Detection in Imbalanced Multi-Class Datasets Using an Optimal MIP-Based Ensemble Weighting ApproachGeorgios Tertytchny, Georgios L. Stavrinides, Maria K. MichaelAAAI 2025 · 3 citations

Related papers

  1. Learning Imbalanced Data with Beneficial Label NoiseGuangzheng Hu, Feng Liu, Mingming Gong, Guanghui Wang et al.ICML 2025
  2. A Re-Balancing Strategy for Class-Imbalanced Classification Based on Instance DifficultySihao Yu, Jiafeng Guo, Ruqing Zhang, Yixing Fan et al.CVPR 2022 · 42 citations
  3. Influence-Balanced Loss for Imbalanced Visual ClassificationSeulki Park, Jongin Lim, Younghan Jeon, Jin Young ChoiICCV 2021 · 183 citations
  4. A Novel Model for Imbalanced Data ClassificationJian Yin, Chunjing Gan, Kaiqi Zhao, Xuan Lin et al.AAAI 2020 · 33 citations
  5. Procrustean Training for Imbalanced Deep LearningHan-Jia Ye, De-Chuan Zhan, Wei-Lun ChaoICCV 2021 · 36 citations
Dusk over the sea between two cliffs drawn in fine vertical lines