EMNLP Findings2021
Minimizing Annotation Effort via Max-Volume Spectral Sampling
Abstract
We address the annotation data bottleneck for sequence classification. Specifically we ask the question: if one has a budget of N annotations, which samples should we select for annotation? The solution we propose looks for diversity in the selected sample, by maximizing the amount of information that is useful for the learning algorithm, or equivalently by minimizing the redundancy of samples in the selection. This is formulated in the context of spectral learning of recurrent functions for sequence classification. Our method represents unlabeled data in the form of a Hankel matrix, and uses the notion of spectral max-volume to find a compact sub-block from which annotation samples are drawn. Experiments on sequence classification confirm that our spectral sampling strategy is in fact efficient and yields good models.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on3
- Deep Batch Active Learning by Diverse, Uncertain Gradient Lower BoundsJordan T. Ash, Chicheng Zhang, Akshay Krishnamurthy, John Langford et al.ICLR 2020 · 974 citations
- Cold-start Active Learning through Self-supervised Language ModelingMichelle Yuan, Hsuan-Tien Lin, Jordan L. Boyd-GraberEMNLP 2020 · 128 citations
- Weakly Supervised Sequence Tagging from Noisy RulesEsteban Safranchik, Shiying Luo, Stephen H. BachAAAI 2020 · 90 citations
Related papers
- Entity Disambiguation on a Tight Labeling BudgetAudi Primadhanty, Ariadna QuattoniEMNLP Findings 2023
- Sequence Modeling with Spectral Mean FlowsJinwoo Kim, Max Beier, Petar Bevanda, Nayun Kim et al.NeurIPS 2025 · 2 citations
- Loss or Gain: Hierarchical Conditional Information Bottleneck Approach for Incomplete Time Series ClassificationShuo Zhang, Jing Wang, Shiqin Nie, Jinghang Yue et al.KDD 2025 · 1 citation
- The Curious Case of In-Training Compression of State Space ModelsMakram Chahine, Philipp Nazari, Daniela Rus, T. Konstantin RuschICLR 2026 · 4 citations
- Beyond Missing Data Imputation: Information-Theoretic Coupling of Missingness and Class Imbalance for Optimal Irregular Time Series ClassificationXin Qin, Mengna Liu, Wenjie Wang, Shuxin Li et al.AAAI 2026
