Lune

EMNLP Findings2024

Random Label Forests: An Ensemble Method with Label Subsampling For Extreme Multi-Label Problems

Sheng-Wei Chen, Chih-Jen Lin

Abstract

Text classification is one of the essential topics in natural language processing, and each text is often associated with multiple labels. Recently, the number of labels has become larger and larger, especially in the applications of e-commerce, so handling text-related e-commerce problems further requires a large memory space in many existing multi-label learning methods. To address the space concern, utilizing a distributed system to share that large memory requirement is a possible solution. We propose "random label forests," a distributed ensemble method with label subsampling, for handling extremely large-scale labels. Random label forests can reduce memory usage per computer while keeping competitive performances over real-world data sets.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text Classification cites LightXML: Transformer with Dynamic Negative Sampling for High-Performance Extreme Multi-label Text Classification
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on3

  1. LightXML: Transformer with Dynamic Negative Sampling for High-Performance Extreme Multi-label Text ClassificationTing Jiang, Deqing Wang, Leilei Sun, Huayi Yang et al.AAAI 2021 · 170 citations
  2. Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text ClassificationJiong Zhang, Wei-Cheng Chang, Hsiang-Fu Yu, Inderjit S. DhillonNeurIPS 2021 · 147 citations
  3. Exploring Space Efficiency in a Tree-based Linear Model for Extreme Multi-label ClassificationHe-Zhe Lin, Cheng-Hung Liu, Chih-Jen LinEMNLP 2024

Related papers

  1. XMC-Agent : Dynamic Navigation over Scalable Hierarchical Index for Incremental Extreme Multi-label ClassificationYanjiang Liu, Tianyun Zhong, Yaojie Lu, Hongyu Lin et al.ACL Findings 2024 · 1 citation
  2. Multilabel Classification by Hierarchical Partitioning and Data-dependent GroupingShashanka Ubaru, Sanjeeb Dash, Arya Mazumdar, Oktay GünlükNeurIPS 2020 · 10 citations
  3. Pretrained Generalized Autoregressive Model with Adaptive Probabilistic Label Clusters for Extreme Multi-label Text ClassificationHui Ye, Zhiyu Chen, Da-Han Wang, Brian D. DavisonICML 2020 · 57 citations
  4. Learning from Weak-Label Data: A Deep Forest ExpeditionQian-Wei Wang, Liang Yang, Yufeng LiAAAI 2020 · 21 citations
  5. Towards Robust Prediction on Tail LabelsTong Wei, Wei-Wei Tu, Yufeng Li, Guo-Ping YangKDD 2021 · 12 citations
Dusk over the sea between two cliffs drawn in fine vertical lines