Lune

ACL Findings2026

DentalGPT: Incentivizing Multimodal Reasoning in Dentistry

Zhenyang Cai, Jiaming Zhang, Junjie Zhao, Ziyi Zeng, Yanchao Li, Liang Jingyi, Junying Chen, Yunjin Yang, Jiajun You, Shuzhi Deng, Xieruiqiii, Yuanting Chen

摘要

Reliable interpretation of multimodal dental data is essential for automated oral healthcare, yet existing multimodal large language models (MLLMs) exhibit limited understanding of dental images. Although complex reasoning improves performance, its gains in dentistry are substantially smaller than in other medical domains, indicating that complex reasoning is not yet sufficiently incentivized for dental diagnosis, likely due to insufficient domain knowledge and limited reinforcement learning on dental questions. We present Dental-GPT, a dentistry-specialized MLLM trained via staged multimodal alignment and reinforcement learning. By constructing the largest annotated multimodal dental dataset to date with over 120k images, multimodal alignment provides the necessary domain knowledge foundation to support and incentivize complex reasoning, which is further strengthened through reinforcement learning. Experiments on expertannotated benchmarks and dental subsets of medical VQA benchmarks show that Dental-GPT achieves superior performance on disease classification and dental VQA tasks, outperforming many state-of-the-art MLLMs despite its compact 7B parameter scale.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper7

  1. Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 次引用
  2. OralGPT-Omni: A Versatile Dental Multimodal Large Language ModelJing Hao, Yuci Liang, Lizhuo Lin, Yuxuan Fan 等CVPR 2026 · 11 次引用
  3. MedXpertQA: Benchmarking Expert-Level Medical Reasoning and UnderstandingYuxin Zuo, Shang Qu, Yifei Li, Zhang-Ren Chen 等ICML 2025
  4. Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksZhe Chen, Jiannan Wu, Wenhai Wang, Weijie Su 等CVPR 2024
  5. Exploring Compositional Generalization of Multimodal LLMs for Medical ImagingZhenyang Cai, Junying Chen, Rongsheng Wang, Weihong Wang 等ACL 2025

相关 Paper

  1. MedReasoner: Reinforcement Learning Drives Reasoning Grounding from Clinical Thought to Pixel-Level PrecisionZhonghao Yan, Muxi Diao, Yuxuan Yang, Ruoyan Jing 等AAAI 2026 · 4 次引用
  2. OralGPT-Plus: Learning to Use Visual Tools via Reinforcement Learning for Panoramic X-ray AnalysisYuxuan Fan, Jing Hao, Hong Chen, Jiahao Bao 等CVPR 2026 · 5 次引用
  3. MLeVLM: Improve Multi-level Progressive Capabilities based on Multimodal Large Language Model for Medical Visual Question AnsweringDexuan Xu, Yanyuan Chen, Jieyi Wang, Yue Huang 等ACL Findings 2024 · 14 次引用
  4. Med-CMR: A Fine-Grained Benchmark Integrating Visual Evidence and Clinical Logic for Medical Complex Multimodal ReasoningHaozhen Gong, Xiaozhong Ji, Yuansen Liu, Wenbin Wu 等CVPR 2026 · 15 次引用
  5. Medical thinking with multiple imagesZonghai Yao, Benlu Wang, Yifan Zhang, Junda Wang 等ICLR 2026 · 6 次引用
黄昏的海面,两侧是细线勾勒的悬崖