ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generators
Qixing Huang, Xiangru Huang, Bo Sun, Zaiwei Zhang, Junfeng Jiang, Chandrajit Bajaj
Abstract
This paper introduces an unsupervised loss for training parametric deformation shape generators. The key idea is to enforce the preservation of local rigidity among the generated shapes. Our approach builds on an approximation of the as-rigid-as possible (or ARAP) deformation energy. We show how to develop the unsupervised loss via a spectral decomposition of the Hessian of the ARAP energy. Our loss nicely decouples pose and shape variations through a robust norm. The loss admits simple closed-form expressions. It is easy to train and can be plugged into any standard generation models, e.g., variational auto-encoder (VAE) and auto-decoder (AD). Experimental results show that our approach outperforms existing shape generation approaches considerably on public benchmark datasets of various shape categories such as human, animal and bone. Our code and data are available at https://github.com/GitBoSun/ARAPReg.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers22
- Neural jacobian fields: learning intrinsic mappings of arbitrary meshesNoam Aigerman, Kunal Gupta, Vladimir G. Kim, Siddhartha Chaudhuri et al.SIGGRAPH 2022 · 60 citations
- TextDeformer: Geometry Manipulation using Text GuidanceWilliam Gao, Noam Aigerman, Thibault Groueix, Vova Kim et al.SIGGRAPH 2023 · 49 citations
- GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative ModelsHaitao Yang, Xiangru Huang, Bo Sun, Chandrajit L. Bajaj et al.ICLR 2024 · 12 citations
- GLASS: Geometric Latent Augmentation for Shape SpacesSanjeev Muralikrishnan, Siddhartha Chaudhuri, Noam Aigerman, Vladimir G. Kim et al.CVPR 2022 · 10 citations
- BaRe-ESA: A Riemannian Framework for Unregistered Human Body ShapesEmmanuel Hartman, Emery Pierson, Martin Bauer, Nicolas Charon et al.ICCV 2023 · 8 citations
Builds on7
- PointFlow: 3D Point Cloud Generation With Continuous Normalizing FlowsGuandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu et al.ICCV 2019 · 794 citations
- Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and GenerationGiorgos Bouritsas, Sergiy Bokhnyak, Stylianos Ploumpis, Stefanos Zafeiriou et al.ICCV 2019 · 187 citations
- Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying KernelsYi Zhou, Chenglei Wu, Zimo Li, Chen Cao et al.NeurIPS 2020 · 98 citations
- Online Adaptation for Consistent Mesh Reconstruction in the WildXueting Li, Sifei Liu, Shalini De Mello, Kihwan Kim et al.NeurIPS 2020 · 62 citations
- Geometric Disentanglement for Generative Latent Shape ModelsTristan Aumentado-Armstrong, Stavros Tsogkas, Allan D. Jepson, Sven J. DickinsonICCV 2019 · 61 citations
Related papers
- Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose TransferHaoyu Chen, Hao Tang, Henglin Shi, Wei Peng et al.ICCV 2021 · 33 citations
- 3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and FacesSimone Foti, Bongjin Koo, Danail Stoyanov, Matthew J. ClarksonCVPR 2022 · 19 citations
- Decoupling Global and Local Representations via Invertible Generative FlowsXuezhe Ma, Xiang Kong, Shanghang Zhang, Eduard H. HovyICLR 2021 · 24 citations
- Neural Shape Deformation PriorsJiapeng Tang, Lev Markhasin, Bi Wang, Justus Thies et al.NeurIPS 2022 · 36 citations
- Unsupervised Volumetric AnimationAliaksandr Siarohin, Willi Menapace, Ivan Skorokhodov, Kyle Olszewski et al.CVPR 2023
