NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go
Marvin Eisenberger, David Novotný, Gael Kerchenbaum, Patrick Labatut, Natalia Neverova, Daniel Cremers, Andrea Vedaldi
Abstract
We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes and produces in one go, i.e. in a single feed forward pass, a smooth interpolation and point-to-point correspondences between them. The interpolation, expressed as a deformation field, changes the pose of the source shape to resemble the target, but leaves the object identity unchanged. NeuroMorph uses an elegant architecture combining graph convolutions with global feature pooling to extract local features. During training, the model is incentivized to create realistic deformations by approximating geodesics on the underlying shape space manifold. This strong geometric prior allows to train our model end-to-end and in a fully unsupervised manner without requiring any manual correspondence annotations. NeuroMorph works well for a large variety of input shapes, including non-isometric pairs from different object categories. It obtains state-of-the-art results for both shape correspondence and interpolation tasks, matching or surpassing the performance of recent unsupervised and supervised methods on multiple benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6e6860c1-945c-454a-a4fd-0a6e28ff8634Cited by top-tier papers45
- Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape MatchingLei Li, Nicolas Donati, Maks OvsjanikovNeurIPS 2022 · 57 citations
- Unsupervised Learning of Robust Spectral Shape MatchingDongliang Cao, Paul Roetzer, Florian BernardSIGGRAPH 2023 · 45 citations
- Spatially and Spectrally Consistent Deep Functional MapsMingze Sun, Shiwei Mao, Puhua Jiang, Maks Ovsjanikov et al.ICCV 2023 · 37 citations
- NCP: Neural Correspondence Prior for Effective Unsupervised Shape MatchingSouhaib Attaiki, Maks OvsjanikovNeurIPS 2022 · 25 citations
- Coherent Point Drift Revisited for Non-rigid Shape Matching and RegistrationAoxiang Fan, Jiayi Ma, Xin Tian, Xiaoguang Mei et al.CVPR 2022 · 25 citations
Builds on8
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
- Occupancy Flow: 4D Reconstruction by Learning Particle DynamicsMichael Niemeyer, Lars M. Mescheder, Michael Oechsle, Andreas GeigerICCV 2019 · 314 citations
- Unsupervised Deep Learning for Structured Shape MatchingJean-Michel Roufosse, Abhishek Sharma, Maks OvsjanikovICCV 2019 · 160 citations
- Deep Shells: Unsupervised Shape Correspondence with Optimal TransportMarvin Eisenberger, Aysim Toker, Laura Leal-Taixé, Daniel CremersNeurIPS 2020 · 107 citations
Related papers
- Spectral Meets Spatial: Harmonising 3D Shape Matching and InterpolationDongliang Cao, Marvin Eisenberger, Nafie El Amrani, Daniel Cremers et al.CVPR 2024
- G-MSM: Unsupervised Multi-Shape Matching with Graph-Based Affinity PriorsMarvin Eisenberger, Aysim Toker, Laura Leal-Taixé, Daniel CremersCVPR 2023
- MAPConNet: Self-supervised 3D Pose Transfer with Mesh and Point Contrastive LearningJiaze Sun, Zhixiang Chen, Tae-Kyun KimICCV 2023 · 2 citations
- CorrNet3D: Unsupervised End-to-End Learning of Dense Correspondence for 3D Point CloudsYiming Zeng, Yue Qian, Zhiyu Zhu, Junhui Hou et al.CVPR 2021
- Deep Geometric Functional Maps: Robust Feature Learning for Shape CorrespondenceNicolas Donati, Abhishek Sharma, Maks OvsjanikovCVPR 2020
