ACL Findings2026
Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTS
Shijia Xu, Zhou Wu, Xiaolong Jia, Yu Wang, Kai Liu, April Xiaowen Dong
Abstract
Retrieval-augmented generation (RAG) substantially extends the knowledge boundary of large language models. However, it still faces two major challenges when handling complex reasoning tasks: low context utilization and frequent hallucinations. To address these issues, we propose Self-Correcting RAG, a unified framework that reformulates retrieval and generation as constrained optimization and path planning. On the input side, we move beyond traditional greedy retrieval and, for the first time, formalize context selection as a multi-dimensional multiplechoice knapsack problem (MMKP), thereby maximizing information density and removing redundancy under a strict token budget. On the output side, we introduce a natural language inference (NLI)-guided Monte Carlo Tree Search (MCTS) mechanism, which leverages test-time compute to dynamically explore reasoning trajectories and validate the faithfulness of generated answers. Experiments on six open-domain and multi-hop QA datasets demonstrate that our method significantly improves reasoning accuracy on complex queries while effectively reducing hallucinations, outperforming strong existing baselines. Our code
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 5 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers5
- MAGMA: A Multi-Graph based Agentic Memory Architecture for AI AgentsDongming Jiang, Yi Li, Guanpeng Li, Bingzhe LiACL 2026 · 32 citations
- Retrieval as Generation: A Unified Framework with Self-Triggered Information PlanningBo Li, Mingda Wang, Gexiang Fang, Shikun Zhang et al.ACL 2026 · 8 citations
- Stable-RAG: Mitigating Retrieval-Permutation-Induced Hallucinations in Retrieval-Augmented GenerationQianchi Zhang, Hainan Zhang, Liang Pang, Hongwei Zheng et al.ACL 2026 · 3 citations
- Debate-of-Thoughts: Resolving Knowledge Conflicts in LLMs Through Internal DeliberationGuocong Li, Qirui Hu, Ping Wang, Guofeng Zhang et al.ACL 2026
- Unleashing Implicit Rewards: Prefix-Value Learning for Distribution-Level OptimizationShiping Gao, Hongzhan Chen, Xiaojun Quan, Qifan Wang et al.ICML 2026
Builds on43
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
- Toolformer: Language Models Can Teach Themselves to Use ToolsTimo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu et al.NeurIPS 2023 · 5,989 citations
- Reflexion: language agents with verbal reinforcement learningNoah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan et al.NeurIPS 2023 · 5,828 citations
Related papers
- MCTS-RAG: Enhancing Retrieval-Augmented Generation with Monte Carlo Tree SearchYunhai Hu, Yilun Zhao, Chen Zhao, Arman CohanEMNLP Findings 2025 · 5 citations
- REAP: Enhancing RAG with Recursive Evaluation and Adaptive Planning for Multi-Hop Question AnsweringYijie Zhu, Haojie Zhou, Wanting Hong, Tailin Liu et al.AAAI 2026
- CARROT: A Learned Cost-Constrained Retrieval Optimization System for RAGZiting Wang, Haitao Yuan, Wei Dong, Gao Cong et al.ICDE 2026 · 1 citation
- CP-Search: A Chain Progressive Search Training Framework Incentivizing the Cognitive Behaviors for Searching in LLMsZehua Wang, Shipeng Li, Buzhou TangAAAI 2026
- You Don't Need Pre-Built Graphs for RAG: Retrieval Augmented Generation with Adaptive Reasoning StructuresShengyuan Chen, Chuang Zhou, Zheng Yuan, Qinggang Zhang et al.AAAI 2026 · 14 citations
