SAL: Sign Agnostic Learning of Shapes From Raw Data
Matan Atzmon, Yaron Lipman
Abstract
Recently, neural networks have been used as implicit representations for surface reconstruction, modelling, learning, and generation. So far, training neural networks to be implicit representations of surfaces required training data sampled from a ground-truth signed implicit functions such as signed distance or occupancy functions, which are notoriously hard to compute. In this paper we introduce Sign Agnostic Learning (SAL), a deep learning approach for learning implicit shape representations directly from raw, unsigned geometric data, such as point clouds and triangle soups. We have tested SAL on the challenging problem of surface reconstruction from an un-oriented point cloud, as well as end-to-end human shape space learning directly from raw scans dataset, and achieved state of the art reconstructions compared to current approaches. We believe SAL opens the door to many geometric deep learning applications with real-world data, alleviating the usual painstaking, often manual pre-process.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 40bb7a26-1f44-44de-a185-c784fc0a2ae8Cited by top-tier papers195
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Efficient Geometry-aware 3D Generative Adversarial NetworksEric R. Chan, Connor Z. Lin, Matthew A. Chan, Koki Nagano et al.CVPR 2022 · 984 citations
- Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category ReconstructionJeremy Reizenstein, Roman Shapovalov, Philipp Henzler, Luca Sbordone et al.ICCV 2021 · 686 citations
- MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface ReconstructionZehao Yu, Songyou Peng, Michael Niemeyer, Torsten Sattler et al.NeurIPS 2022 · 670 citations
Builds on1
Related papers
- SALD: Sign Agnostic Learning with DerivativesMatan Atzmon, Yaron LipmanICLR 2021 · 5 citations
- SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy NetworksJiapeng Tang, Jiabao Lei, Dan Xu, Feiying Ma et al.ICCV 2021 · 84 citations
- Sign-Agnostic Implicit Learning of Surface Self-Similarities for Shape Modeling and Reconstruction From Raw Point CloudsWenbin Zhao, Jiabao Lei, Yuxin Wen, Jianguo Zhang et al.CVPR 2021
- Shape As Points: A Differentiable Poisson SolverSongyou Peng, Chiyu Jiang, Yiyi Liao, Michael Niemeyer et al.NeurIPS 2021 · 311 citations
- Unsupervised Occupancy Learning from Sparse Point CloudAmine Ouasfi, Adnane BoukhaymaCVPR 2024 · 12 citations
