Facial Auto Rigging from 4D Expressions via Skinning Decomposition
Zhihe Zhao, Dongdong Weng, Hanzhi Guo, Jing Hou, Jixiang Zhou
Abstract
This paper proposes a framework that utilizes skinning decomposition to automatically generate facial rigging from 4D expressions. The framework inputs a predefined rigging template and an actor's 4D facial expressions, including a neutral expression, as well as a group of arbitrary expressions. The output includes not only the linear blend skinning weights and joint positions of the actor's head mesh but also other facial components such as teeth and eyes. Compared to traditional methods, this paper applies a soft constraint to optimize joint positions and imposes a fixed sparsity distribution constraint to improve weight distribution. To further enhance rigging efficiency, this paper leverages GPU expression-parallel and CPU vertex-parallel strategies for joint transformation and weight updates, respectively. The experiments show that the proposed method generates high-fidelity facial rigging that outperforms existing solutions in terms of computational speed, joint position correctness, weight distribution correctness, or computational cost.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get da1de8a8-8ab8-4e78-9896-2ae0f1f779e8Related papers
- Neural Face Rigging for Animating and Retargeting Facial Meshes in the WildDafei Qin, Jun Saito, Noam Aigerman, Thibault Groueix et al.SIGGRAPH 2023 · 26 citations
- One Model to Rig Them All: Diverse Skeleton Rigging with UniRigJia-Peng Zhang, Cheng-Feng Pu, Meng-Hao Guo, Yan-Pei Cao et al.SIGGRAPH 2025 · 10 citations
- PhysRig: Differentiable Physics-Based Skinning and Rigging Framework for Realistic Articulated Object ModelingHao Zhang, Haolan Xu, Chun Feng, Varun Jampani et al.ICCV 2025 · 3 citations
- RigAnything: Template-Free Autoregressive Rigging for Diverse 3D AssetsIsabella Liu, Zhan Xu, Wang Yifan, Hao Tan et al.SIGGRAPH 2025 · 11 citations
- VINECS: Video-based Neural Character SkinningZhouyingcheng Liao, Vladislav Golyanik, Marc Habermann, Christian TheobaltCVPR 2024
