Neural Feature Matching in Implicit 3D Representations
Yunlu Chen, Basura Fernando, Hakan Bilen, Thomas Mensink, Efstratios Gavves
Abstract
Recently, neural implicit functions have achieved impressive results for encoding 3D shapes. Conditioning on low-dimensional latent codes generalises a single implicit function to learn shared representation space for a variety of shapes, with the advantage of smooth interpolation. While the benefits from the global latent space do not correspond to explicit points at local level, we propose to track the continuous point trajectory by matching implicit features with the latent code interpolating between shapes, from which we corroborate the hierarchical functionality of the deep implicit functions, where early layers map the latent code to fitting the coarse shape structure, and deeper layers further refine the shape details. Furthermore, the structured representation space of implicit functions enables to apply feature matching for shape deformation, with the benefits to handle topology and semantics inconsistency, such as from an armchair to a chair with no arms, without explicit flow functions or manual annotations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- NeuralIndicator: Implicit Surface Reconstruction from Neural Indicator PriorsShi-Sheng Huang, Guo Chen, Chen Li Heng, Hua HuangICML 2024 · 5 citations
- Semantic Shape Editing with Parametric Implicit TemplatesUday Kusupati, Mathieu Gaillard, Jean-Marc Thiery, Adrien KaiserSIGGRAPH 2024 · 2 citations
- Neural Implicit Shape Editing using Boundary SensitivityArturs Berzins, Moritz Ibing, Leif KobbeltICLR 2023 · 2 citations
Builds on7
- PointFlow: 3D Point Cloud Generation With Continuous Normalizing FlowsGuandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu et al.ICCV 2019 · 794 citations
- Occupancy Flow: 4D Reconstruction by Learning Particle DynamicsMichael Niemeyer, Lars M. Mescheder, Michael Oechsle, Andreas GeigerICCV 2019 · 314 citations
- BAE-NET: Branched Autoencoder for Shape Co-SegmentationZhiqin Chen, Kangxue Yin, Matthew Fisher, Siddhartha Chaudhuri et al.ICCV 2019 · 153 citations
- Learning Implicit Functions for Topology-Varying Dense 3D Shape CorrespondenceFeng Liu, Xiaoming LiuNeurIPS 2020 · 39 citations
- Local Implicit Grid Representations for 3D ScenesChiyu Max Jiang, Avneesh Sud, Ameesh Makadia, Jingwei Huang et al.CVPR 2020
Related papers
- MetaSDF: Meta-Learning Signed Distance FunctionsVincent Sitzmann, Eric R. Chan, Richard Tucker, Noah Snavely et al.NeurIPS 2020 · 302 citations
- Learning Smooth Neural Functions via Lipschitz RegularizationHsueh-Ti Derek Liu, Francis Williams, Alec Jacobson, Sanja Fidler et al.SIGGRAPH 2022 · 63 citations
- Deep Implicit Templates for 3D Shape RepresentationZerong Zheng, Tao Yu, Qionghai Dai, Yebin LiuCVPR 2021
- UNIST: Unpaired Neural Implicit Shape Translation NetworkQimin Chen, Johannes Merz, Aditya Sanghi, Hooman Shayani et al.CVPR 2022 · 15 citations
- Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic FlowShanlin Sun, Kun Han, Deying Kong, Hao Tang et al.CVPR 2022 · 37 citations
