HeatFormer: A Neural Optimizer for Multiview Human Mesh Recovery
Yuto Matsubara, Ko Nishino
Abstract
https://vision.ist.i.kyoto-u.ac.jp/ Figure 1. HeatFormer is a novel neural optimizer for human mesh recovery from static multiview images. It recovers the SMPL shape and pose parameters by fully leveraging the views to resolve occlusions (e.g., note how well the body parts occluded by objects and other body parts are recovered). It is also agnostic to the configuration and number of views which is essential for generalization in real-world scenes. (From left to right, the datasets are Human3.6M [17], BEHAVE [3], MPI-INF-3DHP [36], and RICH [15].
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5af53b2d-51d6-4f6c-8b73-5992b5cff575Builds on27
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the LoopNikos Kolotouros, Georgios Pavlakos, Michael J. Black, Kostas DaniilidisICCV 2019 · 1,139 citations
- Learnable Triangulation of Human PoseKarim Iskakov, Egor Burkov, Victor S. Lempitsky, Yury MalkovICCV 2019 · 419 citations
- Mesh GraphormerKevin Lin, Lijuan Wang, Zicheng LiuICCV 2021 · 399 citations
- HuMoR: 3D Human Motion Model for Robust Pose EstimationDavis Rempe, Tolga Birdal, Aaron Hertzmann, Jimei Yang et al.ICCV 2021 · 398 citations
Related papers
- 3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image DataBenjamin Biggs, David Novotný, Sébastien Ehrhardt, Hanbyul Joo et al.NeurIPS 2020 · 79 citations
- End-to-End Human Pose and Mesh Reconstruction with TransformersKevin Lin, Lijuan Wang, Zicheng LiuCVPR 2021
- Shape-Aware Human Pose and Shape Reconstruction Using Multi-View ImagesJunbang Liang, Ming C. LinICCV 2019 · 91 citations
- Shape-aware Multi-Person Pose Estimation from Multi-View ImagesZijian Dong, Jie Song, Xu Chen, Chen Guo et al.ICCV 2021 · 47 citations
- Tracking People with 3D RepresentationsJathushan Rajasegaran, Georgios Pavlakos, Angjoo Kanazawa, Jitendra MalikNeurIPS 2021 · 30 citations
