Self-Supervised Category-Level 6D Object Pose Estimation with Deep Implicit Shape Representation
Wanli Peng, Jianhang Yan, Hongtao Wen, Yi Sun
Abstract
Category-level 6D pose estimation can be better generalized to unseen objects in a category compared with instance-level 6D pose estimation. However, existing category-level 6D pose estimation methods usually require supervised training with a sufficient number of 6D pose annotations of objects which makes them difficult to be applied in real scenarios. To address this problem, we propose a self-supervised framework for category-level 6D pose estimation in this paper. We leverage DeepSDF as a 3D object representation and design several novel loss functions based on DeepSDF to help the self-supervised model predict unseen object poses without any 6D object pose labels and explicit 3D models in real scenarios. Experiments demonstrate that our method achieves comparable performance with the state-of-the-art fully supervised methods on the category-level NOCS benchmark.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a99f6260-ef0b-4f05-a96c-28175c6ff159Cited by top-tier papers8
- SNI-SLAM: Semantic Neural Implicit SLAMSiting Zhu, Guangming Wang, Hermann Blum, Jiuming Liu et al.CVPR 2024 · 59 citations
- SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape VariationsBoyan Wan, Yifei Shi, Kai XuICCV 2023 · 18 citations
- RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D VideosHongchi Xia, Yang Fu, Sifei Liu, Xiaolong WangCVPR 2024 · 14 citations
- Source-Free and Image-Only Unsupervised Domain Adaptation for Category Level Object Pose EstimationPrakhar Kaushik, Aayush Mishra, Adam Kortylewski, Alan L. YuilleICLR 2024 · 10 citations
- Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the WildKaifeng Zhang, Yang Fu, Shubhankar Borse, Hong Cai et al.ICLR 2023 · 8 citations
Builds on8
- DPOD: 6D Pose Object Detector and RefinerSergey Zakharov, Ivan Shugurov, Slobodan IlicICCV 2019 · 486 citations
- DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose ConsistencyJiehong Lin, Zewei Wei, Zhihao Li, Songcen Xu et al.ICCV 2021 · 169 citations
- DIST: Rendering Deep Implicit Signed Distance Function With Differentiable Sphere TracingShaohui Liu, Yinda Zhang, Songyou Peng, Boxin Shi et al.CVPR 2020
- PVN3D: A Deep Point-Wise 3D Keypoints Voting Network for 6DoF Pose EstimationYisheng He, Wei Sun, Haibin Huang, Jianran Liu et al.CVPR 2020
- FS-Net: Fast Shape-Based Network for Category-Level 6D Object Pose Estimation With Decoupled Rotation MechanismWei Chen, Xi Jia, Hyung Jin Chang, Jinming Duan et al.CVPR 2021
Related papers
- Leveraging SE(3) Equivariance for Self-supervised Category-Level Object Pose Estimation from Point CloudsXiaolong Li, Yijia Weng, Li Yi, Leonidas J. Guibas et al.NeurIPS 2021 · 61 citations
- Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New DatasetYanjie Ze, Xiaolong WangNeurIPS 2022 · 104 citations
- Query6DoF: Learning Sparse Queries as Implicit Shape Prior for Category-Level 6DoF Pose EstimationRuiqi Wang, Xinggang Wang, Te Li, Rong Yang et al.ICCV 2023 · 31 citations
- Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose EstimationXiao Lin, Wenfei Yang, Yuan Gao, Tianzhu ZhangCVPR 2024
- Universal Features Guided Zero-Shot Category-Level Object Pose EstimationWentian Qu, Chenyu Meng, Heng Li, Jian Cheng et al.AAAI 2025
