Adversarial Parametric Pose Prior
Andrey Davydov, Anastasia Remizova, Victor Constantin, Sina Honari, Mathieu Salzmann, Pascal Fua
摘要
The Skinned Multi-Person Linear (SMPL) model can represent a human body by mapping pose and shape parameters to body meshes. This has been shown to facilitate inferring 3D human pose and shape from images via different learning models. However, not all pose and shape parameter values yield physically-plausible or even realistic body meshes. In other words, SMPL is under-constrained and may thus lead to invalid results when used to reconstruct humans from images, either by directly optimizing its parameters, or by learning a mapping from the image to these parameters. In this paper, we therefore learn a prior that restricts the SMPL parameters to values that produce realistic poses via adversarial training. We show that our learned prior covers the diversity of the real-data distribution, facilitates optimization for 3D reconstruction from 2D keypoints, and yields better pose estimates when used for regression from images. We found that the prior based on spherical distribution gets the best results. Furthermore, in all these tasks, it outperforms the state-of-the-art VAE-based approach to constraining the SMPL parameters.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper19
- DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion ModelsKarl Holmquist, Bastian WandtICCV 2023 · 被引用 92 次
- Score-Guided Diffusion for 3D Human RecoveryAnastasis Stathopoulos, Ligong Han, Dimitris N. MetaxasCVPR 2024 · 被引用 15 次
- Bringing Motion Taxonomies to Continuous Domains via GPLVM on Hyperbolic manifoldsNoémie Jaquier, Leonel Rozo, Miguel González Duque, Viacheslav Borovitskiy 等ICML 2024 · 被引用 11 次
- Geometric Neural Distance Fields for Learning Human Motion PriorsZhengdi Yu, Simone Foti, Linguang Zhang, Amy Zhao 等CVPR 2026 · 被引用 8 次
- Recovering Complete Actions for Cross-dataset Skeleton Action RecognitionHanchao Liu, Yujiang Li, Tai-Jiang Mu, Shi-Min HuNeurIPS 2024 · 被引用 7 次
它引用的顶会 Paper4
- AMASS: Archive of Motion Capture As Surface ShapesNaureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll 等ICCV 2019 · 被引用 1,784 次
- Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the LoopNikos Kolotouros, Georgios Pavlakos, Michael J. Black, Kostas DaniilidisICCV 2019 · 被引用 1,139 次
- TexturePose: Supervising Human Mesh Estimation With Texture ConsistencyGeorgios Pavlakos, Nikos Kolotouros, Kostas DaniilidisICCV 2019 · 被引用 109 次
- Coherent Reconstruction of Multiple Humans From a Single ImageWen Jiang, Nikos Kolotouros, Georgios Pavlakos, Xiaowei Zhou 等CVPR 2020
相关 Paper
- 3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image DataBenjamin Biggs, David Novotný, Sébastien Ehrhardt, Hanbyul Joo 等NeurIPS 2020 · 被引用 79 次
- Animatable Virtual Humans: Learning Pose-Dependent Human Representations in UV Space for Interactive Performance SynthesisWieland Morgenstern, Milena T. Bagdasarian, Anna Hilsmann, Peter EisertIEEE VR 2024 · 被引用 7 次
- PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body EstimationKarthik Shetty, Annette Birkhold, Srikrishna Jaganathan, Norbert Strobel 等CVPR 2023
- Skeleton-Aware 3D Human Shape Reconstruction From Point CloudsHaiyong Jiang, Jianfei Cai, Jianmin ZhengICCV 2019 · 被引用 75 次
- Generating 3D People in Scenes Without PeopleYan Zhang, Mohamed Hassan, Heiko Neumann, Michael J. Black 等CVPR 2020
