ACL Findings2024
On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey
Lin Long, Rui Wang, Ruixuan Xiao, Junbo Zhao, Xiao Ding, Gang Chen, Haobo Wang
Abstract
Within the evolving landscape of deep learning, the dilemma of data quantity and quality has been a long-standing problem. The recent advent of Large Language Models (LLMs) offers a data-centric solution to alleviate the limitations of real-world data with synthetic data generation. However, current investigations into this field lack a unified framework and mostly stay on the surface. Therefore, this paper provides an organization of relevant studies based on a generic workflow of synthetic data generation. By doing so, we highlight the gaps within existing research and outline prospective avenues for future study. This work aims to shepherd the academic and industrial communities towards deeper, more methodical inquiries into the capabilities and applications of LLMs-driven synthetic data generation.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
54 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- A Survey on Efficient Large Language Model Training: From Data-centric Perspectives cites Self-Instruct: Aligning Language Models with Self-Generated Instructions
- Escaping Collapse: The Strength of Weak Data for Large Language Model Training cites Self-Instruct: Aligning Language Models with Self-Generated Instructions
- Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation cites TruthfulQA: Measuring How Models Mimic Human Falsehoods
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs cites HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Triplets Better Than Pairs: Towards Stable and Effective Self-Play Fine-Tuning for LLMs cites ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
Cited by top-tier papers54
- Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and ChallengesBolei Ma, Yuting Li, Wei Zhou, Ziwei Gong et al.ACL 2025 · 28 citations
- Escaping Collapse: The Strength of Weak Data for Large Language Model TrainingKareem Amin, Sara Babakniya, Alex Bie, Weiwei Kong et al.NeurIPS 2025 · 17 citations
- Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher DistillationHengyuan Zhang, Shiping Yang, Xiao Liang, Chenming Shang et al.ACL 2026 · 14 citations
- A Survey on Efficient Large Language Model Training: From Data-centric PerspectivesJunyu Luo, Bohan Wu, Xiao Luo, Zhiping Xiao et al.ACL 2025 · 12 citations
- Triplets Better Than Pairs: Towards Stable and Effective Self-Play Fine-Tuning for LLMsYibo Wang, Hai-Long Sun, Guangda Huzhang, Qingguo Chen et al.NeurIPS 2025 · 12 citations
Builds on45
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- TruthfulQA: Measuring How Models Mimic Human FalsehoodsStephanie Lin, Jacob Hilton, Owain EvansACL 2022 · 3,228 citations
- HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging FaceYongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li et al.NeurIPS 2023 · 1,778 citations
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIsYujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu et al.ICLR 2024 · 1,469 citations
- Self-Instruct: Aligning Language Models with Self-Generated InstructionsYizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu et al.ACL 2023 · 540 citations
Related papers
- MALLM-GAN: Multi-Agent Large Language Model as Generative Adversarial Network for Synthesizing Tabular DataYaobin Ling, Xiaoqian Jiang, Yejin KimACL Findings 2026 · 3 citations
- Towards Synthetic Trace Generation of Modeling Operations using In-Context Learning ApproachVittoriano Muttillo, Claudio Di Sipio, Riccardo Rubei, Luca Berardinelli et al.ASE 2024 · 1 citation
- Towards a Theoretical Understanding of Synthetic Data in LLM Post-Training: A Reverse-Bottleneck PerspectiveZeyu Gan, Yong LiuICLR 2025 · 1 citation
- Unveiling the Flaws: Exploring Imperfections in Synthetic Data and Mitigation Strategies for Large Language ModelsJie Chen, Yupeng Zhang, Bingning Wang, Xin Zhao et al.EMNLP Findings 2024 · 11 citations
- DiffLM: Controllable Synthetic Data Generation via Diffusion Language ModelsYing Zhou, Xinyao Wang, Yulei Niu, Yaojie Shen et al.ACL Findings 2025 · 8 citations
