KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control
Tomas Jakab, Richard Tucker, Ameesh Makadia, Jiajun Wu, Noah Snavely, Angjoo Kanazawa
Abstract
Figure 1 : Controlling shape deformation with unsupervised 3D keypoints. We discover unsupervised 3D keypoints that allow for intuitive control of an object's shape. This figure shows individual steps of interactive control. The red arrows illustrate the direction in which the keypoints are manipulated. Note that the resulting deformations are localized and object parts are deformed in an intuitive manner-e.g., moving keypoints at the tip of the wings backward moves the wings backwards-all while preserving the details of the original shape.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 67971dce-73f7-4f43-9374-a4b0012f072dCited by top-tier papers34
- Generative Neural Articulated Radiance FieldsAlexander W. Bergman, Petr Kellnhofer, Wang Yifan, Eric R. Chan et al.NeurIPS 2022 · 144 citations
- LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned KeypointsJunshu Tang, Zhijun Gong, Ran Yi, Yuan Xie et al.CVPR 2022 · 74 citations
- Neural jacobian fields: learning intrinsic mappings of arbitrary meshesNoam Aigerman, Kunal Gupta, Vladimir G. Kim, Siddhartha Chaudhuri et al.SIGGRAPH 2022 · 60 citations
- TextDeformer: Geometry Manipulation using Text GuidanceWilliam Gao, Noam Aigerman, Thibault Groueix, Vova Kim et al.SIGGRAPH 2023 · 49 citations
- Neural Shape Deformation PriorsJiapeng Tang, Lev Markhasin, Bi Wang, Justus Thies et al.NeurIPS 2022 · 36 citations
Builds on8
- Unsupervised Learning of Landmarks by Descriptor Vector ExchangeJames Thewlis, Samuel Albanie, Hakan Bilen, Andrea VedaldiICCV 2019 · 70 citations
- DiscoNet: Shapes Learning on Disconnected Manifolds for 3D EditingÉloi Mehr, Ariane Jourdan, Nicolas Thome, Matthieu Cord et al.ICCV 2019 · 40 citations
- DualSDF: Semantic Shape Manipulation Using a Two-Level RepresentationZekun Hao, Hadar Averbuch-Elor, Noah Snavely, Serge J. BelongieCVPR 2020
- Learning Generative Models of Shape HandlesMatheus Gadelha, Giorgio Gori, Duygu Ceylan, Radomír Mech et al.CVPR 2020
- KeypointNet: A Large-Scale 3D Keypoint Dataset Aggregated From Numerous Human AnnotationsYang You, Yujing Lou, Chengkun Li, Zhoujun Cheng et al.CVPR 2020
Related papers
- Motion Representations for Articulated AnimationAliaksandr Siarohin, Oliver J. Woodford, Jian Ren, Menglei Chai et al.CVPR 2021
- Unsupervised 3D Structure Inference from Category-Specific Image CollectionsWeikang Wang, Dongliang Cao, Florian BernardCVPR 2024
- Generating Part-Aware Editable 3D Shapes without 3D SupervisionKonstantinos Tertikas, Despoina Paschalidou, Boxiao Pan, Jeong Joon Park et al.CVPR 2023
- DiLO: Disentangled Latent Optimization for Learning Shape and Deformation in Grouped Deforming 3D ObjectsMostofa Rafid Uddin, Jana Armouti, Umong Sain, Md. Asib Rahman et al.AAAI 2026
- Local Deformation for Interactive Shape EditingHonglin Chen, Changxi Zheng, Kevin WamplerSIGGRAPH 2023 · 3 citations
