A Survey of Active Learning for Natural Language Processing
Zhisong Zhang, Emma Strubell, Eduard H. Hovy
Abstract
In this work, we provide a literature review of active learning (AL) for its applications in natural language processing (NLP). In addition to a fine-grained categorization of query strategies, we also investigate several other important aspects of applying AL to NLP problems. These include AL for structured prediction tasks, annotation cost, model learning (especially with deep neural models), and starting and stopping AL. Finally, we conclude with a discussion of related topics and future directions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2dde3de4-aab6-4c6d-822e-67193f1de32eCited by top-tier papers20
- Learnability Matters: Active Learning for Video CaptioningYiqian Zhang, Buyu Liu, Jun Bao, Qiang Huang et al.NeurIPS 2024 · 47 citations
- Empowering Active Learning for 3D Molecular Graphs with Geometric Graph IsomorphismRonast Subedi, Lu Wei, Wenhan Gao, Shayok Chakraborty et al.NeurIPS 2024 · 12 citations
- Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive TasksPo-Nien Kung, Fan Yin, Di Wu, Kai-Wei Chang et al.EMNLP 2023 · 7 citations
- Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human SupervisionJiaxin Zhang, Zhuohang Li, Kamalika Das, Kumar SricharanNeurIPS 2023 · 6 citations
- Supporting Co-Adaptive Machine Teaching through Human Concept Learning and Cognitive TheoriesSimret Araya Gebreegziabher, Yukun Yang, Elena L. Glassman, Toby Jia-Jun LiCHI 2025 · 5 citations
Builds on21
- Variational Adversarial Active LearningSamarth Sinha, Sayna Ebrahimi, Trevor DarrellICCV 2019 · 662 citations
- Batch Active Learning at ScaleGui Citovsky, Giulia DeSalvo, Claudio Gentile, Lazaros Karydas et al.NeurIPS 2021 · 220 citations
- Active Learning for BERT: An Empirical StudyLiat Ein-Dor, Alon Halfon, Ariel Gera, Eyal Shnarch et al.EMNLP 2020 · 144 citations
- Cold-start Active Learning through Self-supervised Language ModelingMichelle Yuan, Hsuan-Tien Lin, Jordan L. Boyd-GraberEMNLP 2020 · 128 citations
- SeqMix: Augmenting Active Sequence Labeling via Sequence MixupRongzhi Zhang, Yue Yu, Chao ZhangEMNLP 2020 · 65 citations
Related papers
- Active Learning for Natural Language GenerationYotam Perlitz, Ariel Gera, Michal Shmueli-Scheuer, Dafna Sheinwald et al.EMNLP 2023 · 2 citations
- From Selection to Generation: A Survey of LLM-based Active LearningYu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu et al.ACL 2025 · 18 citations
- On the Fragility of Active Learners for Text ClassificationAbhishek Ghose, Emma NguyenEMNLP 2024 · 2 citations
- Adapting Coreference Resolution Models through Active LearningMichelle Yuan, Patrick Xia, Chandler May, Benjamin Van Durme et al.ACL 2022 · 20 citations
- Subsequence Based Deep Active Learning for Named Entity RecognitionPuria Radmard, Yassir Fathullah, Aldo LipaniACL 2021
