Neural Mesh Flow: 3D Manifold Mesh Generation via Diffeomorphic Flows
Kunal Gupta, Manmohan Chandraker
Abstract
Meshes are important representations of physical 3D entities in the virtual world. Applications like rendering, simulations and 3D printing require meshes to be manifold so that they can interact with the world like the real objects they represent. Prior methods generate meshes with great geometric accuracy but poor manifoldness. In this work, we propose Neural Mesh Flow (NMF) to generate two-manifold meshes for genus-0 shapes. Specifically, NMF is a shape auto-encoder consisting of several Neural Ordinary Differential Equation (NODE)[1]blocks that learn accurate mesh geometry by progressively deforming a spherical mesh. Training NMF is simpler compared to state-of-the-art methods since it does not require any explicit mesh-based regularization. Our experiments demonstrate that NMF facilitates several applications such as single-view mesh reconstruction, global shape parameterization, texture mapping, shape deformation and correspondence. Importantly, we demonstrate that manifold meshes generated using NMF are better-suited for physically-based rendering and simulation. Code and data will be released.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 233e6a42-4c91-4249-98b1-88e5bfb02c0cCited by top-tier papers18
- Zero-Shot Text-Guided Object Generation with Dream FieldsAjay Jain, Ben Mildenhall, Jonathan T. Barron, Pieter Abbeel et al.CVPR 2022 · 361 citations
- Shape As Points: A Differentiable Poisson SolverSongyou Peng, Chiyu Jiang, Yiyi Liao, Michael Niemeyer et al.NeurIPS 2021 · 311 citations
- Geometry Processing with Neural FieldsGuandao Yang, Serge J. Belongie, Bharath Hariharan, Vladlen KoltunNeurIPS 2021 · 109 citations
- CorticalFlow: A Diffeomorphic Mesh Transformer Network for Cortical Surface ReconstructionLéo Lebrat, Rodrigo Santa Cruz, Frédéric de Gournay, Darren Fu et al.NeurIPS 2021 · 46 citations
- Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D MeshesKa-Hei Hui, Ruihui Li, Jingyu Hu, Chi-Wing FuCVPR 2022 · 24 citations
Builds on7
- PointFlow: 3D Point Cloud Generation With Continuous Normalizing FlowsGuandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu et al.ICCV 2019 · 794 citations
- Occupancy Flow: 4D Reconstruction by Learning Particle DynamicsMichael Niemeyer, Lars M. Mescheder, Michael Oechsle, Andreas GeigerICCV 2019 · 314 citations
- Dissecting Neural ODEsStefano Massaroli, Michael Poli, Jinkyoo Park, Atsushi Yamashita et al.NeurIPS 2020 · 261 citations
- On Robustness of Neural Ordinary Differential EquationsHanshu Yan, Jiawei Du, Vincent Y. F. Tan, Jiashi FengICLR 2020 · 161 citations
- Approximation Capabilities of Neural ODEs and Invertible Residual NetworksHan Zhang, Xi Gao, Jacob Unterman, Tom ArodzICML 2020 · 114 citations
Related papers
- Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying KernelsYi Zhou, Chenglei Wu, Zimo Li, Chen Cao et al.NeurIPS 2020 · 98 citations
- Denoising Normalizing FlowChristian Horvat, Jean-Pascal PfisterNeurIPS 2021 · 39 citations
- Moser Flow: Divergence-based Generative Modeling on ManifoldsNoam Rozen, Aditya Grover, Maximilian Nickel, Yaron LipmanNeurIPS 2021 · 86 citations
- Mesh2Tex: Generating Mesh Textures from Image QueriesAlexey Bokhovkin, Shubham Tulsiani, Angela DaiICCV 2023 · 32 citations
- MeshDiffusion: Score-based Generative 3D Mesh ModelingZhen Liu, Yao Feng, Michael J. Black, Derek Nowrouzezahrai et al.ICLR 2023 · 29 citations
