UNIST: Unpaired Neural Implicit Shape Translation Network
Qimin Chen, Johannes Merz, Aditya Sanghi, Hooman Shayani, Ali Mahdavi-Amiri, Hao Zhang
Abstract
We introduce UNIST, the first deep neural implicit model for general-purpose, unpaired shape-to-shape translation, in both 2D and 3D domains. Our model is built on autoencoding implicit fields, rather than point clouds which represents the state of the art. Furthermore, our translation network is trained to perform the task over a latent grid representation which combines the merits of both latent-space processing and position awareness, to not only enable drastic shape transforms but also well preserve spatial features and fine local details for natural shape translations. With the same network architecture and only dictated by the input domain pairs, our model can learn both style-preserving content alteration and content-preserving style transfer. We demonstrate the generality and quality of the translation results, and compare them to well-known baselines. Code is available at https://qiminchen.github.io/unist/ .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c2d4dff8-61eb-4c76-9b27-f0acc3c9f56eBuilds on9
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Neural Sparse Voxel FieldsLingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua et al.NeurIPS 2020 · 1,535 citations
- Multiresolution Deep Implicit Functions for 3D Shape RepresentationZhang Chen, Yinda Zhang, Kyle Genova, Sean Ryan Fanello et al.ICCV 2021 · 57 citations
- Local Implicit Grid Representations for 3D ScenesChiyu Max Jiang, Avneesh Sud, Ameesh Makadia, Jingwei Huang et al.CVPR 2020
Related papers
- Deep Implicit Templates for 3D Shape RepresentationZerong Zheng, Tao Yu, Qionghai Dai, Yebin LiuCVPR 2021
- 3DILG: Irregular Latent Grids for 3D Generative ModelingBiao Zhang, Matthias Nießner, Peter WonkaNeurIPS 2022 · 118 citations
- ShapeFlow: Learnable Deformation Flows Among 3D ShapesChiyu Max Jiang, Jingwei Huang, Andrea Tagliasacchi, Leonidas J. GuibasNeurIPS 2020 · 46 citations
- Neural Feature Matching in Implicit 3D RepresentationsYunlu Chen, Basura Fernando, Hakan Bilen, Thomas Mensink et al.ICML 2021 · 8 citations
- Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable ObjectsBaowen Zhang, Jiahe Li, Xiaoming Deng, Yinda Zhang et al.ICCV 2023 · 10 citations
