Confronting Ambiguity in 6D Object Pose Estimation via Score-Based Diffusion on SE(3)
Tsu-Ching Hsiao, Hao-Wei Chen, Hsuan-Kung Yang, Chun-Yi Lee
Abstract
Addressing pose ambiguity in 6D object pose estimation from single RGB images presents a significant challenge, particularly due to object symmetries or occlusions. In response, we introduce a novel score-based diffusion method applied to the SE(3) group, marking the first application of diffusion models to SE(3) within the image domain, specifically tailored for pose estimation tasks. Extensive evaluations demonstrate the method's efficacy in handling pose ambiguity, mitigating perspective-induced ambiguity, and showcasing the robustness of our surrogate Stein score formulation on SE(3). This formulation not only improves the convergence of denoising process but also enhances computational efficiency. Thus, we pioneer a promising strategy for 6D object pose estimation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f09cc6cb-b947-41c1-bf12-b184ef10c351Cited by top-tier papers7
- 6D-Diff: A Keypoint Diffusion Framework for 6D Object Pose EstimationLi Xu, Haoxuan Qu, Yujun Cai, Jun LiuCVPR 2024 · 29 citations
- Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow ModelsYanbo Xu, Yu Wu, Sungjae Park, Zhizhuo Zhou et al.ICML 2026 · 7 citations
- Learning 3D Object Spatial Relationships From Pre-Trained 2D Diffusion ModelsSangwon Baik, Hyeonwoo Kim, Hanbyul JooICCV 2025 · 7 citations
- Deterministic Object Pose Confidence Region EstimationJinghao Wang, Zhang Li, Zi Wang, Banglei Guan et al.ICCV 2025 · 2 citations
- RayPose: Ray Bundling Diffusion for Template Views in Unseen 6D Object Pose EstimationJunwen Huang, Shishir Reddy Vutukur, Peter KT Yu, Nassir Navab et al.ICCV 2025 · 1 citation
Builds on28
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Video Diffusion ModelsJonathan Ho, Tim Salimans, Alexey A. Gritsenko, William Chan et al.NeurIPS 2022 · 2,948 citations
Related papers
- SE(3) Diffusion Model-based Point Cloud Registration for Robust 6D Object Pose EstimationHaobo Jiang, Mathieu Salzmann, Zheng Dang, Jin Xie et al.NeurIPS 2023 · 51 citations
- Score-Guided Diffusion for 3D Human RecoveryAnastasis Stathopoulos, Ligong Han, Dimitris N. MetaxasCVPR 2024 · 15 citations
- Unified Framework for Diffusion Generative Models in SO(3): Applications in Computer Vision and AstrophysicsYesukhei Jagvaral, François Lanusse, Rachel MandelbaumAAAI 2024 · 10 citations
- Coherent 3D Scene Diffusion From a Single RGB ImageManuel Dahnert, Angela Dai, Norman Müller, Matthias NießnerNeurIPS 2024 · 10 citations
- DiffPose: Toward More Reliable 3D Pose EstimationJia Gong, Lin Geng Foo, Zhipeng Fan, Qiuhong Ke et al.CVPR 2023
