Learning Analytical Posterior Probability for Human Mesh Recovery
Qi Fang, Kang Chen, Yinghui Fan, Qing Shuai, Jiefeng Li, Weidong Zhang
Abstract
Despite various probabilistic methods for modeling the uncertainty and ambiguity in human mesh recovery, their overall precision is limited because existing formulations for joint rotations are either not constrained to SO(3) or difficult to learn for neural networks. To address such an issue, we derive a novel analytical formulation for learning posterior probability distributions of human joint rotations conditioned on bone directions in a Bayesian manner, and based on this, we propose a new posterior-guided framework for human mesh recovery. We demonstrate that our framework is not only superior to existing SOTA baselines on multiple benchmarks but also flexible enough to seamlessly incorporate with additional sensors due to its Bayesian nature. The code is available at https:// github.com/NetEase-GameAI/ProPose .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers14
- AiOS: All-in-One-Stage Expressive Human Pose and Shape EstimationQingping Sun, Yanjun Wang, Ailing Zeng, Wanqi Yin et al.CVPR 2024 · 20 citations
- Score-Guided Diffusion for 3D Human RecoveryAnastasis Stathopoulos, Ligong Han, Dimitris N. MetaxasCVPR 2024 · 15 citations
- PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular VideosYufei Zhang, Jeffrey O. Kephart, Zijun Cui, Qiang JiCVPR 2024 · 14 citations
- PostureHMR: Posture Transformation for 3D Human Mesh RecoveryYu-Pei Song, Xiao Wu, Zhaoquan Yuanl, Jian-Jun Qiao et al.CVPR 2024 · 11 citations
- Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded ImagesDonghwan Kim, Tae-Kyun KimNeurIPS 2024 · 8 citations
Builds on30
- Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the LoopNikos Kolotouros, Georgios Pavlakos, Michael J. Black, Kostas DaniilidisICCV 2019 · 1,139 citations
- PARE: Part Attention Regressor for 3D Human Body EstimationMuhammed Kocabas, Chun-Hao P. Huang, Otmar Hilliges, Michael J. BlackICCV 2021 · 509 citations
- Mesh GraphormerKevin Lin, Lijuan Wang, Zicheng LiuICCV 2021 · 399 citations
- HuMoR: 3D Human Motion Model for Robust Pose EstimationDavis Rempe, Tolga Birdal, Aaron Hertzmann, Jimei Yang et al.ICCV 2021 · 398 citations
- Resolving 3D Human Pose Ambiguities With 3D Scene ConstraintsMohamed Hassan, Vasileios Choutas, Dimitrios Tzionas, Michael J. BlackICCV 2019 · 384 citations
Related papers
- Probabilistic Modeling for Human Mesh RecoveryNikos Kolotouros, Georgios Pavlakos, Dinesh Jayaraman, Kostas DaniilidisICCV 2021 · 201 citations
- Skeleton2Mesh: Kinematics Prior Injected Unsupervised Human Mesh RecoveryZhenbo Yu, Junjie Wang, Jingwei Xu, Bingbing Ni et al.ICCV 2021 · 27 citations
- Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose ModelingOlaf Dünkel, Tim Salzmann, Florian PfaffCVPR 2024
- Implicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-viewHanbyel Cho, Yooshin Cho, Jaesung Ahn, Junmo KimCVPR 2023
- Shape-Aware Human Pose and Shape Reconstruction Using Multi-View ImagesJunbang Liang, Ming C. LinICCV 2019 · 91 citations
