PaNDaS: Learnable Shape Interpolation Modeling with Localized Control
Thomas Besnier, Emery Pierson, Sylvain Arguillere, Maks Ovsjanikov, Mohamed Daoudi
Abstract
We present PaNDaS, a novel deep learning framework for Partial Non-Rigid Deformations and interpolations of Surfaces (PaNDaS). PaNDaS learns a per-face feature field on the source mesh and fuses it with a global encoding of the target. A deformation generator predicts a Jacobian field and recovers a smooth displacement, enabling precise regional control, pose mixing, and transferable local edits. Unlike previous approaches, our method can restrict the deformations to specific parts of the shape in a versatile way. Across various human body part datasets, PaNDaS achieves state-of-the-art interpolation accuracy and stronger locality than methods based on global shape codes or handles, while remaining robust to remeshing. We demonstrate several localized shape manipulation tasks and show that our method can generate new shapes by combining different input deformations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on16
- Drag Your GAN: Interactive Point-based Manipulation on the Generative Image ManifoldXingang Pan, Ayush Tewari, Thomas Leimkühler, Lingjie Liu et al.SIGGRAPH 2023 · 206 citations
- Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and GenerationGiorgos Bouritsas, Sergiy Bokhnyak, Stylianos Ploumpis, Stefanos Zafeiriou et al.ICCV 2019 · 187 citations
- DragDiffusion: Harnessing Diffusion Models for Interactive Point-Based Image EditingYujun Shi, Chuhui Xue, Jun Hao Liew, Jiachun Pan et al.CVPR 2024 · 117 citations
- Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying KernelsYi Zhou, Chenglei Wu, Zimo Li, Chen Cao et al.NeurIPS 2020 · 98 citations
- Neural jacobian fields: learning intrinsic mappings of arbitrary meshesNoam Aigerman, Kunal Gupta, Vladimir G. Kim, Siddhartha Chaudhuri et al.SIGGRAPH 2022 · 60 citations
Related papers
- Neural Shape Deformation PriorsJiapeng Tang, Lev Markhasin, Bi Wang, Justus Thies et al.NeurIPS 2022 · 36 citations
- Neural Pose Representation Learning for Generating and Transferring Non-Rigid Object PosesSeungwoo Yoo, Juil Koo, Kyeongmin Yeo, Minhyuk SungNeurIPS 2024 · 6 citations
- Generalizable Local Feature Pre-training for Deformable Shape AnalysisSouhaib Attaiki, Lei Li, Maks OvsjanikovCVPR 2023
- SPAMs: Structured Implicit Parametric ModelsPablo R. Palafox, Nikolaos Sarafianos, Tony Tung, Angela DaiCVPR 2022 · 26 citations
- Neural Face Rigging for Animating and Retargeting Facial Meshes in the WildDafei Qin, Jun Saito, Noam Aigerman, Thibault Groueix et al.SIGGRAPH 2023 · 26 citations
