Beyond ReAct: A Planner-Centric Framework for Complex Tool-Augmented LLM Reasoning
Xiaolong Wei, Yuehu Dong, Xingliang Wang, Xingyu Zhang, Zhejun Zhao, Dongdong Shen, Long Xia, Dawei Yin
Abstract
Existing tool-augmented large language models (LLMs) encounter significant challenges when processing complex queries. Current frameworks such as ReAct are prone to local optimization traps due to their reliance on incremental decision-making processes. To address these limitations, we propose a novel Planner-centric Plan-Execute paradigm that fundamentally resolves local optimization bottlenecks through architectural innovation. Central to our approach is a novel Planner model that performs global Directed Acyclic Graph (DAG) planning for complex queries, enabling optimized execution beyond conventional tool coordination. We also introduce ComplexTool-Plan, a large-scale benchmark dataset featuring complex queries that demand sophisticated multi-tool composition and coordination capabilities. Additionally, we develop a two-stage training methodology that integrates Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO), systematically enhancing the Planner's tool selection accuracy and global planning awareness through structured DAG-based planning. When integrated with a capable executor, our framework achieves stateof-the-art performance on the StableToolBench benchmark for complex user queries, demonstrating superior end-to-end execution capabilities and robust handling of intricate multitool workflows. Our code and data are publicly available at https://github.com/weixiaolong94-hub/Beyond-React .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c2978d79-0d01-480f-8229-34702c42fefaCited by top-tier papers2
- Retrieval-Augmented Multimodal Model for Fake News DetectionYiheng Li, Weihai Lu, Hanyi Yu, Yue WangSIGIR 2026 · 4 citations
- EvoC2F: Compiling Tool Orchestration for Efficient and Evolvable LLM AgentsLei Wei, Qi Liu, Ruiyang Huang, Xiao Peng et al.ICML 2026
Builds on23
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Toolformer: Language Models Can Teach Themselves to Use ToolsTimo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu et al.NeurIPS 2023 · 5,989 citations
- Reflexion: language agents with verbal reinforcement learningNoah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan et al.NeurIPS 2023 · 5,828 citations
- SWE-agent: Agent-Computer Interfaces Enable Automated Software EngineeringJohn Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret et al.NeurIPS 2024 · 2,059 citations
- HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging FaceYongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li et al.NeurIPS 2023 · 1,778 citations
Related papers
- AutoTool: Efficient Tool Selection for Large Language Model AgentsJingyi Jia, Qinbin LiAAAI 2026 · 4 citations
- CoPE: A Framework for Optimizing Coordination between Planning and Execution in LLM-based AgentsHuanxi Liu, Kun Hu, Qiang Wang, Yuanzhao Zhai et al.ICML 2026
- Small LLMs Are Weak Tool Learners: A Multi-LLM AgentWeizhou Shen, Chenliang Li, Hongzhan Chen, Ming Yan et al.EMNLP 2024 · 18 citations
- OPERA: A Reinforcement Learning-Enhanced Orchestrated Planner-Executor Architecture for Reasoning-Oriented Multi-Hop RetrievalYu Liu, Yanbing Liu, Fangfang Yuan, Cong Cao et al.AAAI 2026 · 4 citations
- Tool-Star: Empowering Multi-Tool Collaborative Web Agent via Reinforcement LearningGuanting Dong, Yifei Chen, Xiaoxi Li, Jiajie Jin et al.SIGIR 2026 · 1 citation
