Learning Deep Implicit Functions for 3D Shapes with Dynamic Code Clouds
Tianyang Li, Xin Wen, Yu-Shen Liu, Hua Su, Zhizhong Han
Abstract
Deep Implicit Function (DIF) has gained popularity as an efficient 3D shape representation. To capture geometry details, current methods usually learn DIF using local latent codes, which discretize the space into a regular 3D grid (or octree) and store local codes in grid points (or octree nodes). Given a query point, the local feature is computed by interpolating its neighboring local codes with their positions. However, the local codes are constrained at discrete and regular positions like grid points, which makes the code positions difficult to be optimized and limits their representation ability. To solve this problem, we propose to learn DIF with Dynamic Code Cloud, named DCC-DIF. Our method explicitly associates local codes with learnable position vectors, and the position vectors are continuous and can be dynamically optimized, which improves the representation ability. In addition, we propose a novel code position loss to optimize the code positions, which heuristically guides more local codes to be distributed around complex geometric details. In contrast to previous methods, our DCC-DIF represents 3D shapes more efficiently with a small amount of local codes, and improves the reconstruction quality. Experi-ments demonstrate that DCC-DIF achieves better performance over previous methods. Code and data are available at https://github.com/lity20/DCCDIF.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f18a1848-08b8-4fff-8ca6-673cfcddcf7dCited by top-tier papers27
- 3DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion ModelsBiao Zhang, Jiapeng Tang, Matthias Nießner, Peter WonkaSIGGRAPH 2023 · 172 citations
- 3DILG: Irregular Latent Grids for 3D Generative ModelingBiao Zhang, Matthias Nießner, Peter WonkaNeurIPS 2022 · 118 citations
- NeuRBF: A Neural Fields Representation with Adaptive Radial Basis FunctionsZhang Chen, Zhong Li, Liangchen Song, Lele Chen et al.ICCV 2023 · 80 citations
- Learning Consistency-Aware Unsigned Distance Functions Progressively from Raw Point CloudsJunsheng Zhou, Baorui Ma, Yu-Shen Liu, Yi Fang et al.NeurIPS 2022 · 77 citations
- Surface Reconstruction from Point Clouds by Learning Predictive Context PriorsBaorui Ma, Yu-Shen Liu, Matthias Zwicker, Zhizhong HanCVPR 2022 · 67 citations
Builds on22
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Learning Shape Templates With Structured Implicit FunctionsKyle Genova, Forrester Cole, Daniel Vlasic, Aaron Sarna et al.ICCV 2019 · 427 citations
- SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-TransformerPeng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao et al.ICCV 2021 · 318 citations
- Acorn: adaptive coordinate networks for neural scene representationJulien N. P. Martel, David B. Lindell, Connor Z. Lin, Eric R. Chan et al.SIGGRAPH 2021 · 165 citations
- Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds From Multiple Angles by Joint Self-Reconstruction and Half-to-Half PredictionZhizhong Han, Xiyang Wang, Yu-Shen Liu, Matthias ZwickerICCV 2019 · 153 citations
Related papers
- Local Deep Implicit Functions for 3D ShapeKyle Genova, Forrester Cole, Avneesh Sud, Aaron Sarna et al.CVPR 2020
- Multiresolution Deep Implicit Functions for 3D Shape RepresentationZhang Chen, Yinda Zhang, Kyle Genova, Sean Ryan Fanello et al.ICCV 2021 · 57 citations
- OctField: Hierarchical Implicit Functions for 3D ModelingJia-Heng Tang, Weikai Chen, Jie Yang, Bo Wang et al.NeurIPS 2021 · 43 citations
- Adaptive Local Basis Functions for Shape CompletionHui Ying, Tianjia Shao, He Wang, Yin Yang et al.SIGGRAPH 2023 · 4 citations
- Dual octree graph networks for learning adaptive volumetric shape representationsPeng-Shuai Wang, Yang Liu, Xin TongSIGGRAPH 2022 · 77 citations
