START: Self-taught Reasoner with Tools
Chengpeng Li, Mingfeng Xue, Zhenru Zhang, Jiaxi Yang, Beichen Zhang, Bowen Yu, Binyuan Hui, Junyang Lin, Xiang Wang, Dayiheng Liu
摘要
Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex reasoning through long chain-of-thought, yet they struggle with precise computations and algorithmic operations. Integrating computational tools with LRMs remains challenging, particularly in activating and enhancing models' tooluse capabilities without compromising their reasoning strengths. We address these challenges through START (Self-taught Reasoner with Tools), introducing two key innovations: (1) Hint-infer, a training-free approach that activates LRMs' latent tool-use capabilities through artificial hints, enabling test-time performance scaling; (2) Hint-RFT, a self-training framework that enables models to learn effective tool utilization through diverse hint patterns and rejection-based data synthesis. Experiments show that START significantly improves state-of-the-art LRMs across challenging benchmarks, including competitionlevel mathematics (AMC23: 95.0%, AIME24: 75.6%) and graduate-level science questions (GPQA: 64.6%). Our analysis reveals that START not only enhances accuracy but also improves reasoning efficiency through strategic tool utilization, demonstrating broad applicability in complex reasoning scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Distilling LLM Agent into Small Models with Retrieval and Code ToolsMinki Kang, Jongwon Jeong, Seanie Lee, Jaewoong Cho 等NeurIPS 2025 · 被引用 51 次
- Toward Effective Tool-Integrated Reasoning via Self-Evolved Preference LearningYifei Chen, Guanting Dong, Zhicheng DouICLR 2026 · 被引用 18 次
- Gecko: A Simulation Environment with Stateful Feedback for Refining Agent Tool CallsZeyu Zhang, Guohao Li, Zhenchang Xing, Alexandros Apostolopoulos 等ICML 2026 · 被引用 1 次
- Discovery and Reinforcement of Tool-Integrated Reasoning Chains via Rollout TreesKun Li, Zenan Xu, Junan Li, Zengrui Jin 等ACL 2026 · 被引用 1 次
- Towards Effective Code-Integrated ReasoningFei Bai, Yingqian Min, Beichen Zhang, Zhipeng Chen 等AAAI 2026
它引用的顶会 Paper2
相关 Paper
- Teaching Language Models to Reason with ToolsChengpeng Li, Zhengyang Tang, Ziniu Li, Mingfeng Xue 等NeurIPS 2025 · 被引用 8 次
- ReTool: Reinforcement Learning for Strategic Tool Use in LLMsJiazhan Feng, Shijue Huang, Xingwei Qu, Ge Zhang 等ICLR 2026 · 被引用 406 次
- AgentMath: Empowering Mathematical Reasoning for Large Language Models via Tool-Augmented AgentHaipeng Luo, Huawen Feng, Qingfeng Sun, Can Xu 等ICLR 2026 · 被引用 22 次
- Training Language Models to Reason EfficientlyDaman Arora, Andrea ZanetteNeurIPS 2025 · 被引用 270 次
- AdaReason: Progressive Training of Multi-LoRA Adapters for Budget-Adaptive Language Reasoning ModelsJiacheng Wang, Tianle Chen, Pengyu Cheng, Xiaofeng Hou 等AAAI 2026
