Neural subdivision
Hsueh-Ti Derek Liu, Vladimir G. Kim, Siddhartha Chaudhuri, Noam Aigerman, Alec Jacobson
Abstract
This paper introduces Neural Subdivision , a novel framework for data-driven coarse-to-fine geometry modeling. During inference, our method takes a coarse triangle mesh as input and recursively subdivides it to a finer geometry by applying the fixed topological updates of Loop Subdivision, but predicting vertex positions using a neural network conditioned on the local geometry of a patch. This approach enables us to learn complex non-linear subdivision schemes, beyond simple linear averaging used in classical techniques. One of our key contributions is a novel self-supervised training setup that only requires a set of high-resolution meshes for learning network weights. For any training shape, we stochastically generate diverse low-resolution discretizations of coarse counterparts, while maintaining a bijective mapping that prescribes the exact target position of every new vertex during the subdivision process. This leads to a very efficient and accurate loss function for conditional mesh generation, and enables us to train a method that generalizes across discretizations and favors preserving the manifold structure of the output. During training we optimize for the same set of network weights across all local mesh patches, thus providing an architecture that is not constrained to a specific input mesh, fixed genus, or category. Our network encodes patch geometry in a local frame in a rotation- and translation-invariant manner. Jointly, these design choices enable our method to generalize well, and we demonstrate that even when trained on a single high-resolution mesh our method generates reasonable subdivisions for novel shapes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 093bda8b-cc96-46fb-b251-ef85c2bae496Cited by top-tier papers21
- Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape SynthesisTianchang Shen, Jun Gao, Kangxue Yin, Ming-Yu Liu et al.NeurIPS 2021 · 652 citations
- TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting DecompositionYongwei Chen, Rui Chen, Jiabao Lei, Yabin Zhang et al.NeurIPS 2022 · 112 citations
- 3DStyleNet: Creating 3D Shapes with Geometric and Texture Style VariationsKangxue Yin, Jun Gao, Maria Shugrina, Sameh Khamis et al.ICCV 2021 · 87 citations
- HodgeNet: learning spectral geometry on triangle meshesDmitriy Smirnov, Justin SolomonSIGGRAPH 2021 · 68 citations
- Surface multigrid via intrinsic prolongationHsueh-Ti Derek Liu, Jiayi Eris Zhang, Mirela Ben-Chen, Alec JacobsonSIGGRAPH 2021 · 51 citations
Builds on3
- PU-GAN: A Point Cloud Upsampling Adversarial NetworkRuihui Li, Xianzhi Li, Chi-Wing Fu, Daniel Cohen-Or et al.ICCV 2019 · 496 citations
- Pixel2Mesh++: Multi-View 3D Mesh Generation via DeformationChao Wen, Yinda Zhang, Zhuwen Li, Yanwei FuICCV 2019 · 279 citations
- Neural Cages for Detail-Preserving 3D DeformationsYifan Wang, Noam Aigerman, Vladimir G. Kim, Siddhartha Chaudhuri et al.CVPR 2020
Related papers
- Learning Manifold Patch-Based Representations of Man-Made ShapesDmitriy Smirnov, Mikhail Bessmeltsev, Justin SolomonICLR 2021 · 5 citations
- Neural Progressive MeshesYun-Chun Chen, Vladimir G. Kim, Noam Aigerman, Alec JacobsonSIGGRAPH 2023 · 20 citations
- Locally Adaptive Neural 3D Morphable ModelsMichail Tarasiou, Rolandos Alexandros Potamias, Eimear O' Sullivan, Stylianos Ploumpis et al.CVPR 2024 · 2 citations
- Self-Supervised Dual ContouringRamana Sundararaman, Roman Klokov, Maks OvsjanikovCVPR 2024 · 2 citations
- NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One GoMarvin Eisenberger, David Novotný, Gael Kerchenbaum, Patrick Labatut et al.CVPR 2021
