GIFS: Neural Implicit Function for General Shape Representation
Jianglong Ye, Yuntao Chen, Naiyan Wang, Xiaolong Wang
Abstract
Recent development of neural implicit function has shown tremendous success on high-quality 3D shape re-construction. However, most works divide the space into inside and outside of the shape, which limits their repre-senting power to single-layer and watertight shapes. This limitation leads to tedious data processing (converting non-watertight raw data to watertight) as well as the incapability of representing general object shapes in the real world. In this work, we propose a novel method to represent general shapes including non-watertight shapes and shapes with multi-layer surfaces. We introduce General Implicit Function for 3D Shape (GIFS), which models the relationships between every two points instead of the relationships between points and surfaces. Instead of dividing 3D space into predefined inside-outside regions, GIFS encodes whether two points are separated by any surface. Experiments on ShapeNet show that GIFS outperforms previous state-of-the-art methods in terms of reconstruction quality, rendering efficiency, and visual fidelity. Project page is available at https://jianglongye.com/gifs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers24
- Learning Consistency-Aware Unsigned Distance Functions Progressively from Raw Point CloudsJunsheng Zhou, Baorui Ma, Yu-Shen Liu, Yi Fang et al.NeurIPS 2022 · 77 citations
- GeoUDF: Surface Reconstruction from 3D Point Clouds via Geometry-guided Distance RepresentationSiyu Ren, Junhui Hou, Xiaodong Chen, Ying He et al.ICCV 2023 · 53 citations
- Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set ProjectionJunsheng Zhou, Baorui Ma, Shujuan Li, Yu-Shen Liu et al.ICCV 2023 · 49 citations
- HSDF: Hybrid Sign and Distance Field for Modeling Surfaces with Arbitrary TopologiesLi Wang, Jie Yang, Weikai Chen, Xiaoxu Meng et al.NeurIPS 2022 · 28 citations
- MV-DeepSDF: Implicit Modeling with Multi-Sweep Point Clouds for 3D Vehicle Reconstruction in Autonomous DrivingYibo Liu, Kelly Zhu, Guile Wu, Yuan Ren et al.ICCV 2023 · 18 citations
Builds on21
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human DigitizationShunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima et al.ICCV 2019 · 1,411 citations
- Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the LoopNikos Kolotouros, Georgios Pavlakos, Michael J. Black, Kostas DaniilidisICCV 2019 · 1,139 citations
Related papers
- Neural-GIF: Neural Generalized Implicit Functions for Animating People in ClothingGarvita Tiwari, Nikolaos Sarafianos, Tony Tung, Gerard Pons-MollICCV 2021 · 130 citations
- 3PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary TopologiesWeikai Chen, Cheng Lin, Weiyang Li, Bo YangCVPR 2022 · 30 citations
- Neural Unsigned Distance Fields for Implicit Function LearningJulian Chibane, Aymen Mir, Gerard Pons-MollNeurIPS 2020 · 415 citations
- Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D ShapesYujie Lu, Long Wan, Nayu Ding, Yulong Wang et al.CVPR 2024 · 7 citations
- Implicit Functions in Feature Space for 3D Shape Reconstruction and CompletionJulian Chibane, Thiemo Alldieck, Gerard Pons-MollCVPR 2020
