Lune

ACL Findings2026

GCoT-Decoding: Unlocking Deep Reasoning Paths for Universal Question Answering

Guanran Luo, Wentao Qiu, Zhongquan Jian, Meihong Wang, Qingqiang Wu

Abstract

Chain-of-Thought (CoT) reasoning can enhance large language models (LLMs), but it requires manually designed prompts to guide the model. Recently proposed CoT-decoding enables the model to generate CoT-style reasoning paths without prompts, but it is only applicable to problems with fixed answer sets. To address this limitation, we propose a general decoding strategy-GCoT-decoding-that extends applicability to a broader range of question-answering tasks. GCoT-decoding employs a two-stage branching method combining Fibonacci sampling and heuristic error backtracking to generate candidate decoding paths. It then splits each path into a reasoning span and an answer span to accurately compute path confidence, and finally aggregates semantically similar paths to identify a consensus answer, replacing traditional majority voting. We conduct extensive experiments on six datasets covering both fixed and free QA tasks. Our method not only maintains strong performance on fixed QA but also achieves significant improvements on free QA, demonstrating its generality.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Tree of Thoughts: Deliberate Problem Solving with Large Language Models cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • Tree of Thoughts: Deliberate Problem Solving with Large Language Models cites Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
  • Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Large Language Models are Zero-Shot Reasoners
  • Large Language Models are Zero-Shot Reasoners cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • Least-to-Most Prompting Enables Complex Reasoning in Large Language Models cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • ANCHOR: Abductive Network Construction with Hierarchical Orchestration for Reliable Probability Inference in Large Language Models cites Tree of Thoughts: Deliberate Problem Solving with Large Language Models
  • ANCHOR: Abductive Network Construction with Hierarchical Orchestration for Reliable Probability Inference in Large Language Models cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • ANCHOR: Abductive Network Construction with Hierarchical Orchestration for Reliable Probability Inference in Large Language Models cites Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
  • Let's Verify Step by Step cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
  • Let's Verify Step by Step cites Large Language Models are Zero-Shot Reasoners
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. ANCHOR: Abductive Network Construction with Hierarchical Orchestration for Reliable Probability Inference in Large Language ModelsWentao Qiu, Guanran Luo, Zhongquan Jian, Jingqi Gao et al.ICML 2026 · 2 citations
  2. STRIDE-ED: A Strategy-Grounded Stepwise Reasoning Framework for Empathetic Dialogue SystemsHongru Ji, Yuyin Fan, Meng Zhao, Xianghua Li et al.ACL 2026 · 1 citation

Builds on27

  1. Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
  2. Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
  3. Let's Verify Step by StepHunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards et al.ICLR 2024 · 3,045 citations
  4. Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
  5. Least-to-Most Prompting Enables Complex Reasoning in Large Language ModelsDenny Zhou, Nathanael Schärli, Le Hou, Jason Wei et al.ICLR 2023 · 318 citations

Related papers

  1. Chain-of-Thought Reasoning Without PromptingXuezhi Wang, Denny ZhouNeurIPS 2024 · 305 citations
  2. Unveiling Confirmation Bias in Chain-of-Thought ReasoningYue Wan, Xiaowei Jia, Xiang Lorraine LiACL Findings 2025 · 1 citation
  3. "Well, Keep Thinking": Enhancing LLM Reasoning with Adaptive Injection DecodingHyunbin Jin, Je Won Yeom, Seunghyun Bae, Taesup KimACL Findings 2025 · 1 citation
  4. Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All ScenariosLei Lin, Jia-Yi Fu, Pengli Liu, Qingyang Li et al.ACL Findings 2024 · 3 citations
  5. What Makes a Good Reasoning Chain? Uncovering Structural Patterns in Long Chain-of-Thought ReasoningGangwei Jiang, Yahui Liu, Zhaoyi Li, Wei Bi et al.EMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines