Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner
Wenchuan Zhang, Penghao Zhang, Jingru Guo, Tao Cheng, Jie Chen, Shuwan Zhang, Zhang Zhang, Yuhao Yi, Hong Bu
摘要
Recent advances in vision-language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging sub-domain, with current pathology-specific VLMs exhibiting limitations in both diagnostic accuracy and reasoning plausibility. Such shortcomings are largely attributable to the nature of current pathology datasets, which are primarily composed of image-description pairs that lack the depth and structured diagnostic paradigms employed by real-world pathologists. In this study, we leverage pathology textbooks and real-world pathology experts to construct high-quality, reasoning-oriented datasets. Building on this, we introduce Patho-R1, a multimodal RLbased pathology Reasoner, trained through a three-stage pipeline: (1) continued pretraining on 3.5 million image-text pairs for knowledge infusion; (2) supervised fine-tuning on 500k high-quality Chain-of-Thought samples for reasoning incentivizing; (3) reinforcement learning using Group Relative Policy Optimization and Decoupled Clip and Dynamic sAmpling Policy Optimization strategies for multimodal reasoning quality refinement. To further assess the alignment quality of our dataset, we propose Patho-CLIP, trained on the same figure-caption corpus used for continued pretraining. Comprehensive experimental results demonstrate that both Patho-CLIP and Patho-R1 achieve robust performance across a wide range of pathology-related tasks, including zero-shot classification, cross-modal retrieval, Visual Question Answering, and Multiple Choice Question. Our project is available at the Patho-R1 repository: https://github.com/Wenchuan-Zhang/Patho-R1 .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- OctoMed: Data Recipes for State-of-the-Art Multimodal Medical ReasoningTimothy Ossowski, Sheng Zhang, Qianchu Liu, Guanghui Qin 等CVPR 2026 · 被引用 10 次
- Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement LearningWenchuan Zhang, Jingru Guo, Hengzhe Zhang, Penghao Zhang 等AAAI 2026 · 被引用 8 次
- Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype ControlMinghao Han, Yichen Liu, Yizhou Liu, Zizhi Chen 等CVPR 2026 · 被引用 5 次
- Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement LearningKaitao Chen, Weiqian Zhao, Jiamin Wu, Qihao Zheng 等ICML 2026
- Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography AnalysisTianwei Lin, Zhongwei Qiu, Jie Cao, Jiang Liu 等ICML 2026
它引用的顶会 Paper20
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- DAPO: An Open-Source LLM Reinforcement Learning System at ScaleQiying Yu, Zheng Zhang, Ruofei Zhu, Yufeng Yuan 等NeurIPS 2025 · 被引用 2,828 次
- MedCLIP: Contrastive Learning from Unpaired Medical Images and TextZifeng Wang, Zhenbang Wu, Dinesh Agarwal, Jimeng SunEMNLP 2022 · 被引用 907 次
- Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language ModelsWenxuan Huang, Bohan Jia, Shaosheng Cao, Zheyu Ye 等ICLR 2026 · 被引用 670 次
相关 Paper
- PathGen-1.6M: 1.6 Million Pathology Image-text Pairs Generation through Multi-agent CollaborationYuxuan Sun, Yunlong Zhang, Yixuan Si, Chenglu Zhu 等ICLR 2025
- CPLIP: Zero-Shot Learning for Histopathology with Comprehensive Vision-Language AlignmentSajid Javed, Arif Mahmood, Iyyakutti Iyappan Ganapathi, Fayaz Ali Dharejo 等CVPR 2024
- CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational PathologyYuxuan Sun, Yixuan Si, Chenglu Zhu, Xuan Gong 等CVPR 2025
- PathAsst: A Generative Foundation AI Assistant towards Artificial General Intelligence of PathologyYuxuan Sun, Chenglu Zhu, Sunyi Zheng, Kai Zhang 等AAAI 2024 · 被引用 92 次
- PathChat-SegR1: Reasoning Segmentation in Pathology via SO-GRPOZelin Liu, Dongdong Chen, Yusong Sun, Yuqi Hu 等ICLR 2026
