ACL2025

QA Analysis in Medical and Legal Domains: A Survey of Data Augmentation in Low-Resource Settings

Benedictus Kent Rachmat, Thomas Gerald, Zheng Zhang, Cyril Grouin

2 citations

Abstract

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP), but their success remains largely confined to high-resource, general-purpose domains. In contrast, applying LLMs to low-resource domains poses significant challenges due to limited training data, domain drift, and strict terminology constraints. This survey provides an overview of the current landscape in domainspecific, low-resource QA with LLMs. We begin by analyzing the coverage and representativeness of specialized-domain QA datasets against large-scale reference datasets what we refer to as ParentQA. Building on this analysis, we survey data-centric strategies to enhance input diversity, including data augmentation techniques. We further discuss evaluation metrics for specialized tasks and consider ethical concerns. By mapping current methodologies and outlining open research questions, this survey aims to guide future efforts in adapting LLMs for robust and responsible use in resource-constrained, domainspecific environments. To facilitate reproducibility, we make our code available at github.com/kentrachmat/survey-da.