OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimation
Dingding Cai, Janne Heikkilä, Esa Rahtu
Abstract
This paper proposes a universal framework, called OVE6D, for model-based 6D object pose estimation from a single depth image and a target object mask. Our model is trained using purely synthetic data rendered from ShapeNet, and, unlike most of the existing methods, it generalizes well on new real-world objects without any fine-tuning. We achieve this by decomposing the 6D pose into viewpoint, in-plane rotation around the camera optical axis and translation, and introducing novel lightweight modules for estimating each component in a cascaded manner. The resulting network contains less than 4M parameters while demon-strating excellent performance on the challenging T-LESS and Occluded LINEMOD datasets without any dataset-specific training. We show that OVE6D outperforms some contemporary deep learning-based pose estimation methods specifically trained for individual objects or datasets with real-world training data. The implementation is available at https://github.com/dingdingcai/OVE6D-pose.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2c1ba3cd-a465-4b56-95ed-0c7e73986e7cCited by top-tier papers17
- FoundationPose: Unified 6D Pose Estimation and Tracking of Novel ObjectsBowen Wen, Wei Yang, Jan Kautz, Stan BirchfieldCVPR 2024 · 215 citations
- SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D PriorsChenyang Ma, Kai Lu, Ta Ying Cheng, Niki Trigoni et al.NeurIPS 2024 · 82 citations
- VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical RepresentationsJiehong Lin, Zewei Wei, Yabin Zhang, Kui JiaICCV 2023 · 57 citations
- Learning Symmetry-Aware Geometry Correspondences for 6D Object Pose EstimationHeng Zhao, Shenxing Wei, Dahu Shi, Wenming Tan et al.ICCV 2023 · 33 citations
- BANSAC: A dynamic BAyesian Network for adaptive SAmple ConsensusValter Piedade, Pedro MiraldoICCV 2023 · 16 citations
Builds on11
- DPOD: 6D Pose Object Detector and RefinerSergey Zakharov, Ivan Shugurov, Slobodan IlicICCV 2019 · 486 citations
- PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose EstimationGuangyuan Zhou, Huiqun Wang, Jiaxin Chen, Di HuangICCV 2021 · 45 citations
- PVN3D: A Deep Point-Wise 3D Keypoints Voting Network for 6DoF Pose EstimationYisheng He, Wei Sun, Haibin Huang, Jianran Liu et al.CVPR 2020
- FS-Net: Fast Shape-Based Network for Category-Level 6D Object Pose Estimation With Decoupled Rotation MechanismWei Chen, Xi Jia, Hyung Jin Chang, Jinming Duan et al.CVPR 2021
- StablePose: Learning 6D Object Poses From Geometrically Stable PatchesYifei Shi, Junwen Huang, Xin Xu, Yifan Zhang et al.CVPR 2021
Related papers
- CDPN: Coordinates-Based Disentangled Pose Network for Real-Time RGB-Based 6-DoF Object Pose EstimationZhigang Li, Gu Wang, Xiangyang JiICCV 2019 · 482 citations
- FS6D: Few-Shot 6D Pose Estimation of Novel ObjectsYisheng He, Yao Wang, Haoqiang Fan, Jian Sun et al.CVPR 2022 · 85 citations
- OCSKB: An Object Component Sketch Knowledge Base for Fast 6D Pose EstimationGuangming Shi, Xuyang Li, Xuemei Xie, Mingxuan Yu et al.ACM MM 2023 · 2 citations
- GDR-Net: Geometry-Guided Direct Regression Network for Monocular 6D Object Pose EstimationGu Wang, Fabian Manhardt, Federico Tombari, Xiangyang JiCVPR 2021
- Multi-Path Learning for Object Pose Estimation Across DomainsMartin Sundermeyer, Maximilian Durner, En Yen Puang, Zoltan-Csaba Marton et al.CVPR 2020
