DTS: Enhancing Large Reasoning Models via Decoding Tree Sketching
Zicheng Xu, Xiuyi Lou, Guanchu Wang, Yu-Neng Chuang, Feng Luo, Guangyao Zheng, Alex Szalay, Zirui Liu, Vladimir Braverman
Abstract
Large Reasoning Models (LRMs) achieve remarkable inference-time improvements through parallel thinking. However, existing methods rely on redundant sampling of reasoning trajectories, failing to effectively explore the reasoning space to uncover high-quality solutions. To address these limitations, we propose Decoding Tree Sketching (DTS), a plug-and-play decoding framework for structural multi-trajectory exploration and reasoning selection. For reasoning exploration, DTS sketches a backbone tree of the reasoning space by selectively branching at decision tokens. For reasoning selection, guided by length-accuracy anti-correlation, DTS designs an early termination to prioritize short and reliable trajectories during decoding. Experimental results across four LRMs and datasets demonstrate that DTS significantly enhances accuracy by 14% and reduces repetitive generation by 8% on average. Notably, DTS enables smaller models to outperform larger models with 10× the size, highlighting its potential to strengthen reasoning capabilities. The source code is available at: https://github.com/ZichengXu/ Decoding-Tree-Sketching .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fd43d57f-6bfb-4e0b-93a1-ac6843411d6eCited by top-tier papers1
Ask how each one uses itBuilds on7
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
- Deep Think with ConfidenceYichao Fu, Xuewei Wang, Hao Zhang, Yuandong Tian et al.ICLR 2026 · 171 citations
- SELF-DISCOVER: Large Language Models Self-Compose Reasoning StructuresPei Zhou, Jay Pujara, Xiang Ren, Xinyun Chen et al.NeurIPS 2024 · 151 citations
- Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language ModelsAbhishek Kumar, Robert Morabito, Sanzhar Umbet, Jad Kabbara et al.ACL 2024 · 9 citations
Related papers
- Dynamic Parallel Tree Search for Efficient LLM ReasoningYifu Ding, Wentao Jiang, Shunyu Liu, Yongcheng Jing et al.ACL 2025
- Policy Guided Tree Search for Enhanced LLM ReasoningYang LiICML 2025
- Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning ModelsWenhui Tan, Fiorenzo Parascandolo, Enver Sangineto, Jianzhong Ju et al.ICML 2026 · 2 citations
- DSG-MCTS: A Dynamic Strategy-Guided Monte Carlo Tree Search for Diversified Reasoning in Large Language ModelsRui Ha, Chaozhuo Li, Rui Pu, Litian Zhang et al.EMNLP 2025
- SpecExit: Accelerating Large Reasoning Model via Speculative ExitRubing Yang, Huajun Bai, Song Liu, Guanghua Yu et al.ICML 2026 · 7 citations
