Multiresolution Deep Implicit Functions for 3D Shape Representation
Zhang Chen, Yinda Zhang, Kyle Genova, Sean Ryan Fanello, Sofien Bouaziz, Christian Häne, Ruofei Du, Cem Keskin, Thomas A. Funkhouser, Danhang Tang
Abstract
We introduce Multiresolution Deep Implicit Functions (MDIF), a hierarchical representation that can recover fine geometry detail, while being able to perform global operations such as shape completion. Our model represents a complex 3D shape with a hierarchy of latent grids, which can be decoded into different levels of detail and also achieve better accuracy. For shape completion, we propose latent grid dropout to simulate partial data in the latent space and therefore defer the completing functionality to the decoder side. This along with our multires design significantly improves the shape completion quality under decoder-only latent optimization. To the best of our knowledge, MDIF is the first deep implicit function model that can at the same time (1) represent different levels of detail and allow progressive decoding; (2) support both encoder-decoder inference and decoder-only latent optimization, and fulfill multiple applications; (3) perform detailed decoder-only shape completion. Experiments demonstrate its superior performance against prior art in various 3D reconstruction tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 04aa2288-506b-4c66-8b8a-93feec165a33Cited by top-tier papers21
- ShapeFormer: Transformer-based Shape Completion via Sparse RepresentationXingguang Yan, Liqiang Lin, Niloy J. Mitra, Dani Lischinski et al.CVPR 2022 · 124 citations
- 3DILG: Irregular Latent Grids for 3D Generative ModelingBiao Zhang, Matthias Nießner, Peter WonkaNeurIPS 2022 · 118 citations
- Bacon: Band-limited Coordinate Networks for Multiscale Scene RepresentationDavid B. Lindell, Dave Van Veen, Jeong Joon Park, Gordon WetzsteinCVPR 2022 · 105 citations
- NeuRBF: A Neural Fields Representation with Adaptive Radial Basis FunctionsZhang Chen, Zhong Li, Liangchen Song, Lele Chen et al.ICCV 2023 · 80 citations
- Towards Implicit Text-Guided 3D Shape GenerationZhengzhe Liu, Yi Wang, Xiaojuan Qi, Chi-Wing FuCVPR 2022 · 59 citations
Builds on8
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Neural Sparse Voxel FieldsLingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua et al.NeurIPS 2020 · 1,535 citations
- Learning Shape Templates With Structured Implicit FunctionsKyle Genova, Forrester Cole, Daniel Vlasic, Aaron Sarna et al.ICCV 2019 · 427 citations
- Local Implicit Grid Representations for 3D ScenesChiyu Max Jiang, Avneesh Sud, Ameesh Makadia, Jingwei Huang et al.CVPR 2020
Related papers
- Learning Deep Implicit Functions for 3D Shapes with Dynamic Code CloudsTianyang Li, Xin Wen, Yu-Shen Liu, Hua Su et al.CVPR 2022 · 44 citations
- Local Deep Implicit Functions for 3D ShapeKyle Genova, Forrester Cole, Avneesh Sud, Aaron Sarna et al.CVPR 2020
- Implicit Functions in Feature Space for 3D Shape Reconstruction and CompletionJulian Chibane, Thiemo Alldieck, Gerard Pons-MollCVPR 2020
- DDIT: Semantic Scene Completion via Deformable Deep Implicit TemplatesHaoang Li, Jinhu Dong, Binghui Wen, Ming Gao et al.ICCV 2023 · 8 citations
- OctField: Hierarchical Implicit Functions for 3D ModelingJia-Heng Tang, Weikai Chen, Jie Yang, Bo Wang et al.NeurIPS 2021 · 43 citations
