DTS: Enhancing Large Reasoning Models via Decoding Tree Sketching
Zicheng Xu, Xiuyi Lou, Guanchu Wang, Yu-Neng Chuang, Feng Luo, Guangyao Zheng, Alex Szalay, Zirui Liu, Vladimir Braverman
摘要
Large Reasoning Models (LRMs) achieve remarkable inference-time improvements through parallel thinking. However, existing methods rely on redundant sampling of reasoning trajectories, failing to effectively explore the reasoning space to uncover high-quality solutions. To address these limitations, we propose Decoding Tree Sketching (DTS), a plug-and-play decoding framework for structural multi-trajectory exploration and reasoning selection. For reasoning exploration, DTS sketches a backbone tree of the reasoning space by selectively branching at decision tokens. For reasoning selection, guided by length-accuracy anti-correlation, DTS designs an early termination to prioritize short and reliable trajectories during decoding. Experimental results across four LRMs and datasets demonstrate that DTS significantly enhances accuracy by 14% and reduces repetitive generation by 8% on average. Notably, DTS enables smaller models to outperform larger models with 10× the size, highlighting its potential to strengthen reasoning capabilities. The source code is available at: https://github.com/ZichengXu/ Decoding-Tree-Sketching .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper7
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 等NeurIPS 2022 · 被引用 22,562 次
- Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le 等ICLR 2023 · 被引用 681 次
- Deep Think with ConfidenceYichao Fu, Xuewei Wang, Hao Zhang, Yuandong Tian 等ICLR 2026 · 被引用 171 次
- SELF-DISCOVER: Large Language Models Self-Compose Reasoning StructuresPei Zhou, Jay Pujara, Xiang Ren, Xinyun Chen 等NeurIPS 2024 · 被引用 151 次
- Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language ModelsAbhishek Kumar, Robert Morabito, Sanzhar Umbet, Jad Kabbara 等ACL 2024 · 被引用 9 次
相关 Paper
- Dynamic Parallel Tree Search for Efficient LLM ReasoningYifu Ding, Wentao Jiang, Shunyu Liu, Yongcheng Jing 等ACL 2025
- Policy Guided Tree Search for Enhanced LLM ReasoningYang LiICML 2025
- Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning ModelsWenhui Tan, Fiorenzo Parascandolo, Enver Sangineto, Jianzhong Ju 等ICML 2026 · 被引用 2 次
- DSG-MCTS: A Dynamic Strategy-Guided Monte Carlo Tree Search for Diversified Reasoning in Large Language ModelsRui Ha, Chaozhuo Li, Rui Pu, Litian Zhang 等EMNLP 2025
- SpecExit: Accelerating Large Reasoning Model via Speculative ExitRubing Yang, Huajun Bai, Song Liu, Guanghua Yu 等ICML 2026 · 被引用 7 次
