Surface Networks via General Covers
Niv Haim, Nimrod Segol, Heli Ben-Hamu, Haggai Maron, Yaron Lipman
Abstract
Developing deep learning techniques for geometric data is an active and fruitful research area. This paper tackles the problem of sphere-type surface learning by developing a novel surface-to-image representation. Using this representation we are able to quickly adapt successful CNN models to the surface setting. The surface-image representation is based on a covering map from the image domain to the surface. Namely, the map wraps around the surface several times, making sure that every part of the surface is well represented in the image. Differently from previous surface-to-image representations, we provide a low distortion coverage of all surface parts in a single image. Specifically, for the use case of learning spherical signals, our representation provides a low distortion alternative to several popular spherical parameterizations used in deep learning. We have used the surface-to-image representation to apply standard CNN architectures to 3D models including spherical signals. We show that our method achieves state of the art or comparable results on the tasks of shape retrieval, shape classification and semantic shape segmentation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers10
- HodgeNet: learning spectral geometry on triangle meshesDmitriy Smirnov, Justin SolomonSIGGRAPH 2021 · 68 citations
- CNNs on surfaces using rotation-equivariant featuresRuben Wiersma, Elmar Eisemann, Klaus HildebrandtSIGGRAPH 2020 · 63 citations
- Equivariance versus Augmentation for Spherical ImagesJan E. Gerken, Oscar Carlsson, Hampus Linander, Fredrik Ohlsson et al.ICML 2022 · 28 citations
- Field Convolutions for Surface CNNsThomas W. Mitchel, Vladimir G. Kim, Michael KazhdanICCV 2021 · 25 citations
- Deep Learning on Implicit Neural Representations of ShapesLuca De Luigi, Adriano Cardace, Riccardo Spezialetti, Pierluigi Zama Ramirez et al.ICLR 2023 · 8 citations
Related papers
- Improving Neural Network Surface Processing with Principal CurvaturesJosquin Harrison, James Benn, Maxime SermesantNeurIPS 2024 · 3 citations
- GSO-Net: Grid Surface Optimization via Learning Geometric ConstraintsChaoyun Wang, Jingmin Xin, Nanning Zheng, Caigui JiangAAAI 2024 · 2 citations
- Unified Brain Surface and Volume RegistrationMazdak Abulnaga, Andrew Hoopes, Malte Hoffmann, Robin Magnet et al.ICLR 2026
- SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface DiscriminatorsAndrew Luo, Tianqin Li, Wen-Hao Zhang, Tai Sing LeeICCV 2021 · 36 citations
- Learning to Orient Surfaces by Self-supervised Spherical CNNsRiccardo Spezialetti, Federico Stella, Marlon Marcon, Luciano Silva et al.NeurIPS 2020 · 48 citations
