EMNLP Findings2024
Random Label Forests: An Ensemble Method with Label Subsampling For Extreme Multi-Label Problems
Sheng-Wei Chen, Chih-Jen Lin
Abstract
Text classification is one of the essential topics in natural language processing, and each text is often associated with multiple labels. Recently, the number of labels has become larger and larger, especially in the applications of e-commerce, so handling text-related e-commerce problems further requires a large memory space in many existing multi-label learning methods. To address the space concern, utilizing a distributed system to share that large memory requirement is a possible solution. We propose "random label forests," a distributed ensemble method with label subsampling, for handling extremely large-scale labels. Random label forests can reduce memory usage per computer while keeping competitive performances over real-world data sets.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on3
- LightXML: Transformer with Dynamic Negative Sampling for High-Performance Extreme Multi-label Text ClassificationTing Jiang, Deqing Wang, Leilei Sun, Huayi Yang et al.AAAI 2021 · 170 citations
- Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text ClassificationJiong Zhang, Wei-Cheng Chang, Hsiang-Fu Yu, Inderjit S. DhillonNeurIPS 2021 · 147 citations
- Exploring Space Efficiency in a Tree-based Linear Model for Extreme Multi-label ClassificationHe-Zhe Lin, Cheng-Hung Liu, Chih-Jen LinEMNLP 2024
Related papers
- XMC-Agent : Dynamic Navigation over Scalable Hierarchical Index for Incremental Extreme Multi-label ClassificationYanjiang Liu, Tianyun Zhong, Yaojie Lu, Hongyu Lin et al.ACL Findings 2024 · 1 citation
- Multilabel Classification by Hierarchical Partitioning and Data-dependent GroupingShashanka Ubaru, Sanjeeb Dash, Arya Mazumdar, Oktay GünlükNeurIPS 2020 · 10 citations
- Pretrained Generalized Autoregressive Model with Adaptive Probabilistic Label Clusters for Extreme Multi-label Text ClassificationHui Ye, Zhiyu Chen, Da-Han Wang, Brian D. DavisonICML 2020 · 57 citations
- Learning from Weak-Label Data: A Deep Forest ExpeditionQian-Wei Wang, Liang Yang, Yufeng LiAAAI 2020 · 21 citations
- Towards Robust Prediction on Tail LabelsTong Wei, Wei-Wei Tu, Yufeng Li, Guo-Ping YangKDD 2021 · 12 citations
