RFMPose: Generative Category-level Object Pose Estimation via Riemannian Flow Matching
Wenzhe Ouyang, Qi Ye, Jinghua Wang, Zenglin Xu, Jiming Chen
Abstract
We introduce RFMPose, a novel generative framework for category-level 6D object pose estimation that learns deterministic pose trajectories through Riemannian Flow Matching (RFM). Existing discriminative approaches struggle with multi-hypothesis predictions (e.g., symmetry ambiguities) and often require specialized network architectures. RFMPose advances this paradigm through three key innovations: (1) Ensuring geometric consistency via geodesic interpolation on Riemannian manifolds combined with bi-invariant metric constraints; (2) Alleviating symmetry-induced ambiguities through Riemannian Optimal Transport for probability mass redistribution without ad-hoc design; (3) Enabling end-to-end likelihood estimation through Hutchinson trace approximation, thereby eliminating auxiliary model dependencies. Extensive experiments on the Omni6DPose demonstrate state-of-the-art performance of the proposed method, with significant improvements of +4.1 in IoU 25 and +2.4 in 5°2cm metrics compared to prior generative approaches. Furthermore, the proposed RFM framework exhibits robust sim-to-real transfer capabilities and facilitates pose tracking extensions with minimal architectural adaptation. Code is available at https://github.com/shabiouyang/RMFPose.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fa71950d-a4cd-4491-a9f3-e68178a73705Cited by top-tier papers1
Ask how each one uses itBuilds on25
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- ScanNet++: A High-Fidelity Dataset of 3D Indoor ScenesChandan Yeshwanth, Yueh-Cheng Liu, Matthias Nießner, Angela DaiICCV 2023 · 659 citations
- FoundationPose: Unified 6D Pose Estimation and Tracking of Novel ObjectsBowen Wen, Wei Yang, Jan Kautz, Stan BirchfieldCVPR 2024 · 215 citations
- Flow Matching on General GeometriesRicky T. Q. Chen, Yaron LipmanICLR 2024 · 193 citations
- SGPA: Structure-Guided Prior Adaptation for Category-Level 6D Object Pose EstimationKai Chen, Qi DouICCV 2021 · 183 citations
Related papers
- Metric Flow Matching for Smooth Interpolations on the Data ManifoldKacper Kapusniak, Peter Potaptchik, Teodora Reu, Leo Zhang et al.NeurIPS 2024 · 89 citations
- Riemannian Variational Flow Matching for Material and Protein DesignOlga Zaghen, Floor Eijkelboom, Alison Pouplin, Cong Liu et al.ICLR 2026 · 10 citations
- Shape-Constraint Recurrent Flow for 6D Object Pose EstimationYang Hai, Rui Song, Jiaojiao Li, Yinlin HuCVPR 2023
- Symmetry and Uncertainty-Aware Object SLAM for 6DoF Object Pose EstimationNathaniel Merrill, Yuliang Guo, Xingxing Zuo, Xinyu Huang et al.CVPR 2022 · 42 citations
- Categorical Flow Matching on Statistical ManifoldsChaoran Cheng, Jiahan Li, Jian Peng, Ge LiuNeurIPS 2024 · 48 citations
