DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation
Hugo Bertiche, Meysam Madadi, Emilio Tylson, Sergio Escalera
Abstract
We present a novel solution to the garment animation problem through deep learning. Our contribution allows animating any template outfit with arbitrary topology and geometric complexity. Recent works develop models for garment edition, resizing and animation at the same time by leveraging the support body model (encoding garments as body homotopies). This leads to complex engineering solutions that suffer from scalability, applicability and compatibility. By limiting our scope to garment animation only, we are able to propose a simple model that can animate any outfit, independently of its topology, vertex order or connectivity. Our proposed architecture maps outfits to animated 3D models into the standard format for 3D animation (blend weights and blend shapes matrices), automatically providing of compatibility with any graphics engine. We also propose a methodology to complement supervised learning with an unsupervised physically based learning that implicitly solves collisions and enhances cloth quality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 283fab40-c840-48af-a3a7-e51ea7fac728Cited by top-tier papers9
- Neural-GIF: Neural Generalized Implicit Functions for Animating People in ClothingGarvita Tiwari, Nikolaos Sarafianos, Tony Tung, Gerard Pons-MollICCV 2021 · 130 citations
- PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video SequenceZijian Dong, Chen Guo, Jie Song, Xu Chen et al.CVPR 2022 · 60 citations
- ISP: Multi-Layered Garment Draping with Implicit Sewing PatternsRen Li, Benoît Guillard, Pascal FuaNeurIPS 2023 · 54 citations
- Learning 3D Garment Animation from Trajectories of A Piece of ClothYidi Shao, Chen Change Loy, Bo DaiNeurIPS 2024 · 3 citations
- Human Geometry Distribution for 3D Animation GenerationXiangjun Tang, Biao Zhang, Peter WonkaCVPR 2026 · 2 citations
Builds on3
- Multi-Garment Net: Learning to Dress 3D People From ImagesBharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, Gerard Pons-MollICCV 2019 · 447 citations
- Tex2Shape: Detailed Full Human Body Geometry From a Single ImageThiemo Alldieck, Gerard Pons-Moll, Christian Theobalt, Marcus A. MagnorICCV 2019 · 343 citations
- TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment StyleChaitanya Patel, Zhouyingcheng Liao, Gerard Pons-MollCVPR 2020
Related papers
- Learning Anchor Transformations for 3D Garment AnimationFang Zhao, Zekun Li, Shaoli Huang, Junwu Weng et al.CVPR 2023
- Point-Based Modeling of Human ClothingIlya Zakharkin, Kirill Mazur, Artur Grigorev, Victor LempitskyICCV 2021 · 53 citations
- Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-OnIgor Santesteban, Nils Thuerey, Miguel A. Otaduy, Dan CasasCVPR 2021
- CaPhy: Capturing Physical Properties for Animatable Human AvatarsZhaoqi Su, Liangxiao Hu, Siyou Lin, Hongwen Zhang et al.ICCV 2023 · 18 citations
- Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single ImagesHeming Zhu, Lingteng Qiu, Yuda Qiu, Xiaoguang HanCVPR 2022 · 32 citations
