Lune

EMNLP Findings2025

Structure Trumps Size: Rethinking Data Quality for LLM Reasoning

Hu Xu, Zeyan Li, Rui Wang, Jianfeng Xu

Abstract

As domain-specific datasets continue to expand, Large Language Models (LLMs) have achieved significant improvements across various fields through supervised fine-tuning (SFT). However, is more data always better for model fine-tuning? Through a series of controlled experiments, we discover that dataset structure-rather than mere size-plays a decisive role in enhancing LLM reasoning capabilities. While existing methods acknowledge that good data quality can make training more efficient, they primarily rely on simple heuristic strategies and lack systematic, quantitative frameworks for evaluating data quality. To address this gap, we introduce MCSQ-the first multi-dimensional quantitative framework for reasoning data management. MCSQ rigorously evaluates and optimizes datasets along six orthogonal dimensions. Through comprehensive controlled experiments, we find that selectively incorporating "distorted" (model-disagreed) or "mismatched" (low-relevance) samples-which are typically discarded in traditional approaches-can outperform conventional "clean" data on certain advanced reasoning benchmarks. Our findings challenge traditional assumptions about data "quality" in LLM fine-tuning and provide actionable, quantitative guidance for efficient, structure-aware dataset management. The datasets and codes are both available at https://github.com/xuhu0115/MCSQ.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Tree of Thoughts: Deliberate Problem Solving with Large Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Large Language Models are Zero-Shot Reasoners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Finetuned Language Models are Zero-Shot Learners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on17

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  2. Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
  3. Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
  4. Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
  5. Finetuned Language Models are Zero-Shot LearnersJason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu et al.ICLR 2022 · 4,966 citations

Related papers

  1. Towards Efficient Medical Reasoning with Minimal Fine-Tuning DataXinlin Zhuang, Feilong Tang, Haolin Yang, Xiwei Liu et al.CVPR 2026 · 3 citations
  2. Differential Fine-Tuning Large Language Models Towards Better Diverse Reasoning AbilitiesXiaosong Yuan, Chen Shen, Shaotian Yan, kaiyuan liu et al.ICLR 2026 · 6 citations
  3. MASS: Mathematical Data Selection via Skill Graphs for Pretraining Large Language ModelsJiazheng Li, Lu Yu, Qing Cui, Zhiqiang Zhang et al.ICML 2025
  4. The Emperor's New Reasoning: Format Imitation Overshadows Genuine Mathematical Understanding in SFTLinyao Yang, Jian-Tao Huang, Yafei Lu, Zhenhui Jessie Li et al.EMNLP 2025
  5. DESIGNER: Design-Logic-Guided Multidisciplinary Data Synthesis for LLM ReasoningWeize Liu, Yongchi Zhao, Yijia Luo, Mingyu Xu et al.ICLR 2026 · 6 citations
Dusk over the sea between two cliffs drawn in fine vertical lines