NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go
Marvin Eisenberger, David Novotný, Gael Kerchenbaum, Patrick Labatut, Natalia Neverova, Daniel Cremers, Andrea Vedaldi
摘要
We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes and produces in one go, i.e. in a single feed forward pass, a smooth interpolation and point-to-point correspondences between them. The interpolation, expressed as a deformation field, changes the pose of the source shape to resemble the target, but leaves the object identity unchanged. NeuroMorph uses an elegant architecture combining graph convolutions with global feature pooling to extract local features. During training, the model is incentivized to create realistic deformations by approximating geodesics on the underlying shape space manifold. This strong geometric prior allows to train our model end-to-end and in a fully unsupervised manner without requiring any manual correspondence annotations. NeuroMorph works well for a large variety of input shapes, including non-isometric pairs from different object categories. It obtains state-of-the-art results for both shape correspondence and interpolation tasks, matching or surpassing the performance of recent unsupervised and supervised methods on multiple benchmarks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper45
- Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape MatchingLei Li, Nicolas Donati, Maks OvsjanikovNeurIPS 2022 · 被引用 57 次
- Unsupervised Learning of Robust Spectral Shape MatchingDongliang Cao, Paul Roetzer, Florian BernardSIGGRAPH 2023 · 被引用 45 次
- Spatially and Spectrally Consistent Deep Functional MapsMingze Sun, Shiwei Mao, Puhua Jiang, Maks Ovsjanikov 等ICCV 2023 · 被引用 37 次
- NCP: Neural Correspondence Prior for Effective Unsupervised Shape MatchingSouhaib Attaiki, Maks OvsjanikovNeurIPS 2022 · 被引用 25 次
- Coherent Point Drift Revisited for Non-rigid Shape Matching and RegistrationAoxiang Fan, Jiayi Ma, Xin Tian, Xiaoguang Mei 等CVPR 2022 · 被引用 25 次
它引用的顶会 Paper8
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui 等ICCV 2019 · 被引用 3,193 次
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon 等ICML 2020 · 被引用 1,001 次
- Occupancy Flow: 4D Reconstruction by Learning Particle DynamicsMichael Niemeyer, Lars M. Mescheder, Michael Oechsle, Andreas GeigerICCV 2019 · 被引用 314 次
- Unsupervised Deep Learning for Structured Shape MatchingJean-Michel Roufosse, Abhishek Sharma, Maks OvsjanikovICCV 2019 · 被引用 160 次
- Deep Shells: Unsupervised Shape Correspondence with Optimal TransportMarvin Eisenberger, Aysim Toker, Laura Leal-Taixé, Daniel CremersNeurIPS 2020 · 被引用 107 次
相关 Paper
- Spectral Meets Spatial: Harmonising 3D Shape Matching and InterpolationDongliang Cao, Marvin Eisenberger, Nafie El Amrani, Daniel Cremers 等CVPR 2024
- G-MSM: Unsupervised Multi-Shape Matching with Graph-Based Affinity PriorsMarvin Eisenberger, Aysim Toker, Laura Leal-Taixé, Daniel CremersCVPR 2023
- MAPConNet: Self-supervised 3D Pose Transfer with Mesh and Point Contrastive LearningJiaze Sun, Zhixiang Chen, Tae-Kyun KimICCV 2023 · 被引用 2 次
- CorrNet3D: Unsupervised End-to-End Learning of Dense Correspondence for 3D Point CloudsYiming Zeng, Yue Qian, Zhiyu Zhu, Junhui Hou 等CVPR 2021
- Deep Geometric Functional Maps: Robust Feature Learning for Shape CorrespondenceNicolas Donati, Abhishek Sharma, Maks OvsjanikovCVPR 2020
