Neural Cages for Detail-Preserving 3D Deformations
Yifan Wang, Noam Aigerman, Vladimir G. Kim, Siddhartha Chaudhuri, Olga Sorkine-Hornung
Abstract
We propose a novel learnable representation for detailpreserving shape deformation. The goal of our method is to warp a source shape to match the general structure of a target shape, while preserving the surface details of the source. Our method extends a traditional cage-based deformation technique, where the source shape is enclosed by a coarse control mesh termed cage, and translations prescribed on the cage vertices are interpolated to any point on the source mesh via special weight functions. The use of this sparse cage scaffolding enables preserving surface details regardless of the shape's intricacy and topology. Our key contribution is a novel neural network architecture for predicting deformations by controlling the cage. We incorporate a differentiable cage-based deformation module in our architecture, and train our network end-to-end. Our method can be trained with common collections of 3D models in an unsupervised fashion, without any cage-specific annotations. We demonstrate the utility of our method for synthesizing shape variations and deformation transfer.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 508c2924-bd8d-4faf-8cd1-7c1d64b3166cCited by top-tier papers57
- NeRF-Editing: Geometry Editing of Neural Radiance FieldsYu-Jie Yuan, Yang-Tian Sun, Yu-Kun Lai, Yuewen Ma et al.CVPR 2022 · 206 citations
- Generative Neural Articulated Radiance FieldsAlexander W. Bergman, Petr Kellnhofer, Wang Yifan, Eric R. Chan et al.NeurIPS 2022 · 144 citations
- TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting DecompositionYongwei Chen, Rui Chen, Jiabao Lei, Yabin Zhang et al.NeurIPS 2022 · 112 citations
- Geometry Processing with Neural FieldsGuandao Yang, Serge J. Belongie, Bharath Hariharan, Vladlen KoltunNeurIPS 2021 · 109 citations
- 3DStyleNet: Creating 3D Shapes with Geometric and Texture Style VariationsKangxue Yin, Jun Gao, Maria Shugrina, Sameh Khamis et al.ICCV 2021 · 87 citations
Builds on2
Related papers
- CageNeRF: Cage-based Neural Radiance Field for Generalized 3D Deformation and AnimationYicong Peng, Yichao Yan, Shengqi Liu, Yuhao Cheng et al.NeurIPS 2022 · 72 citations
- ShapeFlow: Learnable Deformation Flows Among 3D ShapesChiyu Max Jiang, Jingwei Huang, Andrea Tagliasacchi, Leonidas J. GuibasNeurIPS 2020 · 46 citations
- Learning skeletal articulations with neural blend shapesPeizhuo Li, Kfir Aberman, Rana Hanocka, Libin Liu et al.SIGGRAPH 2021 · 88 citations
- Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable ObjectsBaowen Zhang, Jiahe Li, Xiaoming Deng, Yinda Zhang et al.ICCV 2023 · 10 citations
- Neural jacobian fields: learning intrinsic mappings of arbitrary meshesNoam Aigerman, Kunal Gupta, Vladimir G. Kim, Siddhartha Chaudhuri et al.SIGGRAPH 2022 · 60 citations
