MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision
Ben Usman, Andrea Tagliasacchi, Kate Saenko, Avneesh Sud
Abstract
In the era of deep learning, human pose estimation from multiple cameras with unknown calibration has received little attention to date. We show how to train a neural model to perform this task with high precision and minimal latency overhead. The proposed model takes into account joint location uncertainty due to occlusion from multiple views, and requires only 2D keypoint data for training. Our method outperforms both classical bundle adjustment and weakly-supervised monocular 3D baselines on the well-established Human3.6M dataset, as well as the more challenging in-the-wild Ski-Pose PTZ dataset.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext aabe5343-22e0-4655-bcbd-1eda1622821cCited by top-tier papers3
- SparsePose: Sparse-View Camera Pose Regression and RefinementSamarth Sinha, Jason Y. Zhang, Andrea Tagliasacchi, Igor Gilitschenski et al.CVPR 2023
- BKinD-3D: Self-Supervised 3D Keypoint Discovery from Multi-View VideosJennifer J. Sun, Lili Karashchuk, Amil Dravid, Serim Ryou et al.CVPR 2023
- Unsupervised Monocular 3D Keypoint Discovery from Multi-View Diffusion PriorsSubin Jeon, In Cho, Junyoung Hong, Woong Oh Cho et al.CVPR 2026
Builds on14
- Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the LoopNikos Kolotouros, Georgios Pavlakos, Michael J. Black, Kostas DaniilidisICCV 2019 · 1,139 citations
- Learnable Triangulation of Human PoseKarim Iskakov, Egor Burkov, Victor S. Lempitsky, Yury MalkovICCV 2019 · 419 citations
- Vector Neurons: A General Framework for SO(3)-Equivariant NetworksCongyue Deng, Or Litany, Yueqi Duan, Adrien Poulenard et al.ICCV 2021 · 411 citations
- SPEC: Seeing People in the Wild with an Estimated CameraMuhammed Kocabas, Chun-Hao P. Huang, Joachim Tesch, Lea Müller et al.ICCV 2021 · 181 citations
- Weakly-Supervised 3D Human Pose Learning via Multi-View Images in the WildUmar Iqbal, Pavlo Molchanov, Jan KautzCVPR 2020
Related papers
- 3D Human Pose Estimation from Multiple Dynamic Views via Single-view Pretraining with Procrustes AlignmentRenshu Gu, Jiajun Zhu, Yixuan Si, Fei Gao et al.ACM MM 2024 · 1 citation
- CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the WildBastian Wandt, Marco Rudolph, Petrissa Zell, Helge Rhodin et al.CVPR 2021
- Geometry-Driven Self-Supervised Method for 3D Human Pose EstimationYang Li, Kan Li, Shuai Jiang, Ziyue Zhang et al.AAAI 2020 · 40 citations
- Towards Alleviating the Modeling Ambiguity of Unsupervised Monocular 3D Human Pose EstimationZhenbo Yu, Bingbing Ni, Jingwei Xu, Junjie Wang et al.ICCV 2021 · 39 citations
- Deductive Learning for Weakly-Supervised 3D Human Pose Estimation via Uncalibrated CamerasXipeng Chen, Pengxu Wei, Liang LinAAAI 2021 · 14 citations
