Geometry Processing with Neural Fields
Guandao Yang, Serge J. Belongie, Bharath Hariharan, Vladlen Koltun
Abstract
Most existing geometry processing algorithms use meshes as the default shape representation. Manipulating meshes, however, requires one to maintain high quality in the surface discretization. For example, changing the topology of a mesh usually requires additional procedures such as remeshing. This paper instead proposes the use of neural fields for geometry processing. Neural fields can compactly store complicated shapes without spatial discretization. Moreover, neural fields are infinitely differentiable, which allows them to be optimized for objectives that involve higher-order derivatives. This raises the question: can geometry processing be done entirely using neural fields? We introduce loss functions and architectures to show that some of the most challenging geometry processing tasks, such as deformation and filtering, can be done with neural fields. Experimental results show that our methods are on par with the well-established mesh-based methods without committing to a particular surface discretization. Code is available at https://github.com/stevenygd/NFGP .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e2535494-2b2b-44c3-bd2a-3012bbcefd72Cited by top-tier papers41
- Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D CameraHongrui Cai, Wanquan Feng, Xuetao Feng, Yan Wang et al.NeurIPS 2022 · 83 citations
- NeuPhysics: Editable Neural Geometry and Physics from Monocular VideosYi-Ling Qiao, Alexander Gao, Ming C. LinNeurIPS 2022 · 62 citations
- Signal Processing for Implicit Neural RepresentationsDejia Xu, Peihao Wang, Yifan Jiang, Zhiwen Fan et al.NeurIPS 2022 · 62 citations
- Neural jacobian fields: learning intrinsic mappings of arbitrary meshesNoam Aigerman, Kunal Gupta, Vladimir G. Kim, Siddhartha Chaudhuri et al.SIGGRAPH 2022 · 60 citations
- Implicit Neural Spatial Representations for Time-dependent PDEsHonglin Chen, Rundi Wu, Eitan Grinspun, Changxi Zheng et al.ICML 2023 · 54 citations
Builds on24
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human DigitizationShunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima et al.ICCV 2019 · 1,411 citations
- Multiview Neural Surface Reconstruction by Disentangling Geometry and AppearanceLior Yariv, Yoni Kasten, Dror Moran, Meirav Galun et al.NeurIPS 2020 · 1,010 citations
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
Related papers
- Implicit-ARAP: Efficient Handle-Guided Neural Field Deformation via Local Patch MeshingDaniele Baieri, Filippo Maggioli, Emanuele Rodolà, Simone Melzi et al.NeurIPS 2025 · 4 citations
- Neural Geometry Fields For MeshesVenkataram Edavamadathil Sivaram, Tzu-Mao Li, Ravi RamamoorthiSIGGRAPH 2024 · 13 citations
- Neural Implicit Shape Editing using Boundary SensitivityArturs Berzins, Moritz Ibing, Leif KobbeltICLR 2023 · 2 citations
- Learning Smooth Neural Functions via Lipschitz RegularizationHsueh-Ti Derek Liu, Francis Williams, Alec Jacobson, Sanja Fidler et al.SIGGRAPH 2022 · 63 citations
- NeuroGF: A Neural Representation for Fast Geodesic Distance and Path QueriesQijian Zhang, Junhui Hou, Yohanes Yudhi Adikusuma, Wenping Wang et al.NeurIPS 2023 · 11 citations
