Learning Smooth Neural Functions via Lipschitz Regularization
Hsueh-Ti Derek Liu, Francis Williams, Alec Jacobson, Sanja Fidler, Or Litany
Abstract
Neural implicit fields have recently emerged as a useful representation for 3D shapes. These fields are commonly represented as neural networks which map latent descriptors and 3D coordinates to implicit function values. The latent descriptor of a neural field acts as a deformation handle for the 3D shape it represents. Thus, smoothness with respect to this descriptor is paramount for performing shape-editing operations. In this work, we introduce a novel regularization designed to encourage smooth latent spaces in neural fields by penalizing the upper bound on the field’s Lipschitz constant. Compared with prior Lipschitz regularized networks, ours is computationally fast, can be implemented in four lines of code, and requires minimal hyperparameter tuning for geometric applications. We demonstrate the effectiveness of our approach on shape interpolation and extrapolation as well as partial shape reconstruction from 3D point clouds, showing both qualitative and quantitative improvements over existing state-of-the-art and non-regularized baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 38a79184-9370-494b-aba3-dc9c47855273Cited by top-tier papers48
- Input Perturbation Reduces Exposure Bias in Diffusion ModelsMang Ning, Enver Sangineto, Angelo Porrello, Simone Calderara et al.ICML 2023 · 100 citations
- A Policy-Guided Imitation Approach for Offline Reinforcement LearningHaoran Xu, Li Jiang, Jianxiong Li, Xianyuan ZhanNeurIPS 2022 · 86 citations
- Direct Parameterization of Lipschitz-Bounded Deep NetworksRuigang Wang, Ian R. ManchesterICML 2023 · 66 citations
- On the Effectiveness of Lipschitz-Driven Rehearsal in Continual LearningLorenzo Bonicelli, Matteo Boschini, Angelo Porrello, Concetto Spampinato et al.NeurIPS 2022 · 64 citations
- ReNeRF: Relightable Neural Radiance Fields with Nearfield LightingYingyan Xu, Gaspard Zoss, Prashanth Chandran, Markus Gross et al.ICCV 2023 · 41 citations
Builds on6
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
- Soft Rasterizer: A Differentiable Renderer for Image-Based 3D ReasoningShichen Liu, Weikai Chen, Tianye Li, Hao LiICCV 2019 · 789 citations
- Exactly Computing the Local Lipschitz Constant of ReLU NetworksMatt Jordan, Alexandros G. DimakisNeurIPS 2020 · 156 citations
- Adversarial Lipschitz RegularizationDávid TerjékICLR 2020 · 55 citations
- Deep geometric texture synthesisAmir Hertz, Rana Hanocka, Raja Giryes, Daniel Cohen-OrSIGGRAPH 2020 · 55 citations
Related papers
- Neural Feature Matching in Implicit 3D RepresentationsYunlu Chen, Basura Fernando, Hakan Bilen, Thomas Mensink et al.ICML 2021 · 8 citations
- Iso-Points: Optimizing Neural Implicit Surfaces With Hybrid RepresentationsYifan Wang, Shihao Wu, Cengiz Öztireli, Olga Sorkine-HornungCVPR 2021
- SPAGHETTI: editing implicit shapes through part aware generationAmir Hertz, Or Perel, Raja Giryes, Olga Sorkine-Hornung et al.SIGGRAPH 2022 · 59 citations
- Neural Fields as Learnable Kernels for 3D ReconstructionFrancis Williams, Zan Gojcic, Sameh Khamis, Denis Zorin et al.CVPR 2022 · 54 citations
- NeuralIndicator: Implicit Surface Reconstruction from Neural Indicator PriorsShi-Sheng Huang, Guo Chen, Chen Li Heng, Hua HuangICML 2024 · 5 citations
