Adversarial Parametric Pose Prior
Andrey Davydov, Anastasia Remizova, Victor Constantin, Sina Honari, Mathieu Salzmann, Pascal Fua
Abstract
The Skinned Multi-Person Linear (SMPL) model can represent a human body by mapping pose and shape parameters to body meshes. This has been shown to facilitate inferring 3D human pose and shape from images via different learning models. However, not all pose and shape parameter values yield physically-plausible or even realistic body meshes. In other words, SMPL is under-constrained and may thus lead to invalid results when used to reconstruct humans from images, either by directly optimizing its parameters, or by learning a mapping from the image to these parameters. In this paper, we therefore learn a prior that restricts the SMPL parameters to values that produce realistic poses via adversarial training. We show that our learned prior covers the diversity of the real-data distribution, facilitates optimization for 3D reconstruction from 2D keypoints, and yields better pose estimates when used for regression from images. We found that the prior based on spherical distribution gets the best results. Furthermore, in all these tasks, it outperforms the state-of-the-art VAE-based approach to constraining the SMPL parameters.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers19
- DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion ModelsKarl Holmquist, Bastian WandtICCV 2023 · 92 citations
- Score-Guided Diffusion for 3D Human RecoveryAnastasis Stathopoulos, Ligong Han, Dimitris N. MetaxasCVPR 2024 · 15 citations
- Bringing Motion Taxonomies to Continuous Domains via GPLVM on Hyperbolic manifoldsNoémie Jaquier, Leonel Rozo, Miguel González Duque, Viacheslav Borovitskiy et al.ICML 2024 · 11 citations
- Geometric Neural Distance Fields for Learning Human Motion PriorsZhengdi Yu, Simone Foti, Linguang Zhang, Amy Zhao et al.CVPR 2026 · 8 citations
- Recovering Complete Actions for Cross-dataset Skeleton Action RecognitionHanchao Liu, Yujiang Li, Tai-Jiang Mu, Shi-Min HuNeurIPS 2024 · 7 citations
Builds on4
- AMASS: Archive of Motion Capture As Surface ShapesNaureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll et al.ICCV 2019 · 1,784 citations
- Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the LoopNikos Kolotouros, Georgios Pavlakos, Michael J. Black, Kostas DaniilidisICCV 2019 · 1,139 citations
- TexturePose: Supervising Human Mesh Estimation With Texture ConsistencyGeorgios Pavlakos, Nikos Kolotouros, Kostas DaniilidisICCV 2019 · 109 citations
- Coherent Reconstruction of Multiple Humans From a Single ImageWen Jiang, Nikos Kolotouros, Georgios Pavlakos, Xiaowei Zhou et al.CVPR 2020
Related papers
- 3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image DataBenjamin Biggs, David Novotný, Sébastien Ehrhardt, Hanbyul Joo et al.NeurIPS 2020 · 79 citations
- Animatable Virtual Humans: Learning Pose-Dependent Human Representations in UV Space for Interactive Performance SynthesisWieland Morgenstern, Milena T. Bagdasarian, Anna Hilsmann, Peter EisertIEEE VR 2024 · 7 citations
- PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body EstimationKarthik Shetty, Annette Birkhold, Srikrishna Jaganathan, Norbert Strobel et al.CVPR 2023
- Skeleton-Aware 3D Human Shape Reconstruction From Point CloudsHaiyong Jiang, Jianfei Cai, Jianmin ZhengICCV 2019 · 75 citations
- Generating 3D People in Scenes Without PeopleYan Zhang, Mohamed Hassan, Heiko Neumann, Michael J. Black et al.CVPR 2020
