Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors
Chao Chen, Yu-Shen Liu, Zhizhong Han
Abstract
It is important to estimate an accurate signed distance function (SDF) from a point cloud in many computer vision applications. The latest methods learn neural SDFs using either a data-driven based or an overfitting-based strategy. However, these two kinds of methods are with either poor generalization or slow convergence, which limits their capability under challenging scenarios like highly noisy point clouds. To resolve this issue, we propose a method to promote pros of both data-driven based and overfitting-based methods for better generalization, faster inference, and higher accuracy in learning neural SDFs. We introduce a novel statistical reasoning algorithm in local regions which is able to finetune data-driven based priors without signed distance supervision, clean point cloud, or point normals. This helps our method start with a good initialization, and converge to a minimum in a much faster way. Our numerical and visual comparisons with the state-of-the-art methods show our superiority over these methods in surface reconstruction and point cloud denoising on widely used shape and scene benchmarks. The code is available at https://github.com/chenchao15/LocalN2NM.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers9
- Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level SetWenyuan Zhang, Yu-Shen Liu, Zhizhong HanNeurIPS 2024 · 58 citations
- SGAD-SLAM: Splatting Gaussians at Adjusted Depth for Better Radiance Fields in RGBD SLAMPengchong Hu, Zhizhong HanCVPR 2026 · 2 citations
- Sensing Surface Patches in Volume Rendering for Inferring Signed Distance FunctionsSijia Jiang, Tong Wu, Jing Hua, Zhizhong HanAAAI 2025 · 2 citations
- Sharpening Neural Implicit Functions with Frequency Consolidation PriorsChao Chen, Yu-Shen Liu, Zhizhong HanAAAI 2025 · 1 citation
- NoiseSDF2NoiseSDF: Learning Clean Neural Fields from Noisy SupervisionTengkai Wang, Weihao Li, Ruikai Cui, Shi Qiu et al.ICML 2026 · 1 citation
Builds on57
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
- Multiview Neural Surface Reconstruction by Disentangling Geometry and AppearanceLior Yariv, Yoni Kasten, Dror Moran, Meirav Galun et al.NeurIPS 2020 · 1,010 citations
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
Related papers
- Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise to Noise MappingBaorui Ma, Yu-Shen Liu, Zhizhong HanICML 2023 · 35 citations
- Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning PriorsChao Chen, Yu-Shen Liu, Zhizhong HanCVPR 2023
- Surface Reconstruction from Point Clouds by Learning Predictive Context PriorsBaorui Ma, Yu-Shen Liu, Matthias Zwicker, Zhizhong HanCVPR 2022 · 67 citations
- Reconstructing Surfaces for Sparse Point Clouds with On-Surface PriorsBaorui Ma, Yu-Shen Liu, Zhizhong HanCVPR 2022 · 66 citations
- MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-StepTakeshi Noda, Chao Chen, Weiqi Zhang, Xinhai Liu et al.NeurIPS 2024 · 19 citations
