Intervene When It Doubts: Conjunction-Guided Interactive Reasoning
Qianyue Wang, Jinwu Hu, Yaofo Chen, Yufeng Wang, Bailin Chen, Huanxiang Lin, Yu Rong, Yuanqing Li, Zhiquan Wen, Mingkui Tan
摘要
Large Reasoning Models (LRMs) excel at complex reasoning but suffer from inefficient reasoning, notably overthinking and overshoot. These issues stem from excessive or misdirected reasoning triggered by the model's "doubt", which manifested as self-validation and exploratory extension, thereby increasing computational cost and degrading performance. Existing efficientreasoning methods regulate reasoning via internal signals or static schedules, but they are not tailored to the doubt-related characteristics of LRMs. To address this, we propose a Conjunction-Guided Intervention (CGI) reasoning framework that intervenes when the model shows signs of doubt. Our key insight is that overthinking and overshoot in LRMs arise from conjunctiontriggered extensions where LRMs signal "doubt" through transitional conjunctions, and then extend redundant self-validation or exploration without timely state-based correction. Building on this insight, CGI pauses reasoning at conjunction-based markers of doubt and injects external state-based feedback, adaptively extending or terminating reasoning to reduce redundancy while preserving accuracy. The feedback is generated through criterion-based evaluation of rationality and completeness and comes from either human or LLM proxies. We train the target model with Group Relative Policy Optimization (GRPO) to adapt to the interactive reasoning mode. Experiments show that our framework achieves a superior balance between accuracy and reasoning length.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper23
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida 等NeurIPS 2022 · 被引用 24,707 次
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 被引用 19,162 次
- Reflexion: language agents with verbal reinforcement learningNoah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan 等NeurIPS 2023 · 被引用 5,828 次
- Self-Refine: Iterative Refinement with Self-FeedbackAman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan 等NeurIPS 2023 · 被引用 4,972 次
- Let's Verify Step by StepHunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards 等ICLR 2024 · 被引用 3,045 次
相关 Paper
- From "Aha Moments" to Controllable Thinking: Toward Meta-Cognitive Reasoning in LRMs via Decoupled Reasoning and ControlRui Ha, Rui Pu, Chaozhuo Li, Li Sun 等ACL 2026 · 被引用 5 次
- Optimizing Length Compression in Large Reasoning ModelsZhengxiang Cheng, Dongping Chen, Mingyang Fu, Tianyi ZhouACL 2026 · 被引用 32 次
- When Simple Problems Wear Complex Costumes: Improving Efficiency in LRM's Adaptive ReasoningJunnan Ren, Yan Zhang, Qian Chen, Yunhang Shen 等ICML 2026
- Learning to Reason over Continuous Tokens with Reinforcement LearningYiran Zhao, Yuhui Xu, Doyen Sahoo, Caiming Xiong 等ICLR 2026 · 被引用 1 次
- Incentivizing Dual Process Thinking for Efficient Large Language Model ReasoningXiaoxue Cheng, Junyi Li, Zhenduo Zhang, Xinyu Tang 等NeurIPS 2025 · 被引用 25 次
