Mesh-RFT: Enhancing Mesh Generation via Fine-grained Reinforcement Fine-Tuning
Jian Liu, Jing Xu, Song Guo, Jing Li, Jingfeng Guo, Jiaao Yu, Haohan Weng, Biwen Lei, Xianghui Yang, Zhuo Chen, Fangqi Zhu, Tao Han, Chunchao Guo
Abstract
Existing pretrained models for 3D mesh generation often suffer from data biases and produce low-quality results, while global reinforcement learning (RL) methods rely on object-level rewards that struggle to capture local structure details. To address these challenges, we present Mesh-RFT, a novel fine-grained reinforcement fine-tuning framework that employs Masked Direct Preference Optimization (M-DPO) to enable localized refinement via quality-aware face masking. To facilitate efficient quality evaluation, we introduce an objective topology-aware scoring system to evaluate geometric integrity and topological regularity at both object and face levels through two metrics: Boundary Edge Ratio (BER) and Topology Score (TS). By integrating these metrics into a fine-grained RL strategy, Mesh-RFT becomes the first method to optimize mesh quality at the granularity of individual faces, resolving localized errors while preserving global coherence. Experiment results show that our M-DPO approach reduces Hausdorff Distance (HD) by 24.6% and improves Topology Score (TS) by 3.8% over pre-trained models, while outperforming global DPO methods with a 17.4% HD reduction and 4.9% TS gain. These results demonstrate Mesh-RFT's ability to improve geometric integrity and topological regularity, achieving new state-of-the-art performance in production-ready mesh generation. Project Page: https://hitcslj.github.io/mesh-rft/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 03ecaca2-bd02-448c-8451-3737b7369accCited by top-tier papers13
- ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and UnderstandingJunliang Ye, Zhengyi Wang, Ruowen Zhao, Shenghao Xie et al.NeurIPS 2025 · 42 citations
- QuadGPT: Native Quadrilateral Mesh Generation with Autoregressive ModelsJian Liu, Chunshi Wang, Song Guo, Haohan Weng et al.ICLR 2026 · 15 citations
- MeshRipple: Structured Autoregressive Generation of Artist-MeshesJunKai Lin, Hang Long, Huipeng Guo, Jielei Zhang et al.CVPR 2026 · 9 citations
- LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentsTianhao Zhao, Youjia Zhang, Hang Long, Jinshen Zhang et al.ICML 2026 · 6 citations
- FACE: A Face-based Autoregressive Representation for High-Fidelity and Efficient Mesh GenerationHanxiao Wang, Yuanchen Guo, Ying-Tian Liu, Zi-Xin Zou et al.CVPR 2026 · 6 citations
Builds on30
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- DAPO: An Open-Source LLM Reinforcement Learning System at ScaleQiying Yu, Zheng Zhang, Ruofei Zhu, Yufeng Yuan et al.NeurIPS 2025 · 2,828 citations
- ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score DistillationZhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao et al.NeurIPS 2023 · 1,498 citations
- ImageReward: Learning and Evaluating Human Preferences for Text-to-Image GenerationJiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong et al.NeurIPS 2023 · 1,310 citations
- Efficient Memory Management for Large Language Model Serving with PagedAttentionWoosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng et al.SOSP 2023 · 1,016 citations
Related papers
- DeepMesh: Auto-Regressive Artist-Mesh Creation with Reinforcement LearningRuowen Zhao, Junliang Ye, Zhengyi Wang, Guangce Liu et al.ICCV 2025 · 9 citations
- Mesh-Pro: Asynchronous Advantage-guided Ranking Preference Optimization for Artist-style Quadrilateral Mesh GenerationZhen Zhou, Jian Liu, Biwen Lei, Jing Xu et al.CVPR 2026 · 2 citations
- Are We Ready for RL in Text-to-3D Generation? A Progressive InvestigationYiwen Tang, Ziyu Guo, Kaixin Zhu, Ray Zhang et al.CVPR 2026 · 11 citations
- BuildingGPT: Auto-Regressive Building Wireframe Reconstruction Model with Reinforcement LearningYuzhou Liu, Lingjie Zhu, Hanqiao Ye, Yujun Liu et al.CVPR 2026
- Topology-Preserved Auto-regressive Mesh Generation in the Manner of Weaving SilkGaochao Song, Zibo Zhao, Haohan Weng, Jingbo Zeng et al.ICLR 2026 · 6 citations
