Neural-Pull: Learning Signed Distance Function from Point clouds by Learning to Pull Space onto Surface
Baorui Ma, Zhizhong Han, Yu-Shen Liu, Matthias Zwicker
Abstract
Reconstructing continuous surfaces from 3D point clouds is a fundamental operation in 3D geometry processing. Several recent state-of-the-art methods address this problem using neural networks to learn signed distance functions (SDFs). In this paper, we introduce Neural-Pull, a new approach that is simple and leads to high quality SDFs. Specifically, we train a neural network to pull query 3D locations to their closest points on the surface using the predicted signed distance values and the gradient at the query locations, both of which are computed by the network itself. The pulling operation moves each query location with a stride given by the distance predicted by the network. Based on the sign of the distance, this may move the query location along or against the direction of the gradient of the SDF. This is a differentiable operation that allows us to update the signed distance value and the gradient simultaneously during training. Our outperforming results under widely used benchmarks demonstrate that we can learn SDFs more accurately and flexibly for surface reconstruction and single image reconstruction than the state-of-the-art methods. Our code and data are available at https: //github.com/mabaorui/NeuralPull .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers37
- Diffusion-SDF: Conditional Generative Modeling of Signed Distance FunctionsGene Chou, Yuval Bahat, Felix HeideICCV 2023 · 171 citations
- Shape-Guided Dual-Memory Learning for 3D Anomaly DetectionYu-Min Chu, Chieh Liu, Ting-I Hsieh, Hwann-Tzong Chen et al.ICML 2023 · 80 citations
- Learning Consistency-Aware Unsigned Distance Functions Progressively from Raw Point CloudsJunsheng Zhou, Baorui Ma, Yu-Shen Liu, Yi Fang et al.NeurIPS 2022 · 77 citations
- Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level SetWenyuan Zhang, Yu-Shen Liu, Zhizhong HanNeurIPS 2024 · 58 citations
- Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set ProjectionJunsheng Zhou, Baorui Ma, Shujuan Li, Yu-Shen Liu et al.ICCV 2023 · 49 citations
Builds on28
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human DigitizationShunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima et al.ICCV 2019 · 1,411 citations
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
- UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View ReconstructionMichael Oechsle, Songyou Peng, Andreas GeigerICCV 2021 · 885 citations
Related papers
- MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-StepTakeshi Noda, Chao Chen, Weiqi Zhang, Xinhai Liu et al.NeurIPS 2024 · 19 citations
- Reconstructing Surfaces for Sparse Point Clouds with On-Surface PriorsBaorui Ma, Yu-Shen Liu, Zhizhong HanCVPR 2022 · 66 citations
- Surface Reconstruction from Point Clouds by Learning Predictive Context PriorsBaorui Ma, Yu-Shen Liu, Matthias Zwicker, Zhizhong HanCVPR 2022 · 67 citations
- Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning PriorsChao Chen, Yu-Shen Liu, Zhizhong HanCVPR 2023
- GridPull: Towards Scalability in Learning Implicit Representations from 3D Point CloudsChao Chen, Yu-Shen Liu, Zhizhong HanICCV 2023 · 19 citations
