R³: End-to-End Reasoning-based Planning for Multi-step Retrosynthesis via Reinforcement Learning
YiFei Wang, Qizhi Pei, Jiangtao Feng, Yuntian Shi, Yi Duan, Lihao Wang, Lei Bai, Lijun Wu, Wei-Ying Ma, Hao Zhou
摘要
Multi-step retrosynthetic planning is a fundamental challenge in organic chemistry, traditionally modeled as a combinatorial search problem guided by single-step prediction models. However, this search-centric paradigm often disconnects from the explicit chemical reasoning processes employed by human experts. In this paper, we propose R 3 (Reinforced Reasoning Retrosynthesis), a novel framework that reformulates this task as end-to-end generative reasoning. Instead of traversing a search tree, R 3 simulates the problem-solving logic of chemists to directly generate complete synthetic pathways. To achieve this, we initialize the model with domain knowledge and employ end-to-end Reinforcement Learning (RL) to optimize the entire planning policy. Experimental results on Retrobench show that R 3 achieves a state-of-the-art Top-1 accuracy of 43.7%, demonstrating that generative reasoning offers a superior alternative to traditional search algorithms in solving complex retrosynthetic problems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- DAPO: An Open-Source LLM Reinforcement Learning System at ScaleQiying Yu, Zheng Zhang, Ruofei Zhu, Yufeng Yuan 等NeurIPS 2025 · 被引用 2,828 次
- Retro*: Learning Retrosynthetic Planning with Neural Guided A* SearchBinghong Chen, Chengtao Li, Hanjun Dai, Le SongICML 2020 · 被引用 151 次
- HybridFlow: A Flexible and Efficient RLHF FrameworkGuangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu 等EuroSys 2025 · 被引用 61 次
- Self-Improved Retrosynthetic PlanningJunsu Kim, Sungsoo Ahn, Hankook Lee, Jinwoo ShinICML 2021 · 被引用 39 次
- Retrosynthetic Planning with Dual Value NetworksGuoqing Liu, Di Xue, Shufang Xie, Yingce Xia 等ICML 2023 · 被引用 24 次
相关 Paper
- Retro-R1: LLM-based Agentic RetrosynthesisWei Liu, Jiangtao Feng, Hongli Yu, Yuxuan Song 等NeurIPS 2025 · 被引用 8 次
- LLM-Augmented Chemical Synthesis and Design Decision ProgramsHaorui Wang, Jeff Guo, Lingkai Kong, Rampi Ramprasad 等ICML 2025
- RetrOrchestrator: A Multi-Step Retrosynthesis Agent Dynamically Orchestrating Single-Step Transition ModelsLiao Chang, Luotian Yuan, Yiping Ke, Ying WeiICML 2026
- Retro-Expert: Collaborative Reasoning for Interpretable RetrosynthesisXinyi Li, Sai Wang, Yutian Lin, Yu WuICML 2026 · 被引用 4 次
- RetroInText: A Multimodal Large Language Model Enhanced Framework for Retrosynthetic Planning via In-Context Representation LearningChenglong Kang, Xiaoyi Liu, Fei GuoICLR 2025
