Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimation
Zitian Wang, Xuecheng Nie, Xiaochao Qu, Yunpeng Chen, Si Liu
Abstract
In this paper, we present a novel Distribution-Aware Single-stage (DAS) model for tackling the challenging multi-person 3D pose estimation problem. Different from existing top-down and bottom-up methods, the proposed DAS model simultaneously localizes person positions and their corresponding body joints in the 3D camera space in a one-pass manner. This leads to a simplified pipeline with enhanced efficiency. In addition, DAS learns the true distribution of body joints for the regression of their positions, rather than making a simple Laplacian or Gaussian assumption as previous works. This provides valuable priors for model prediction and thus boosts the regression-based scheme to achieve competitive performance with volumetric-base ones. Moreover, DAS exploits a recur-sive update strategy for progressively approaching to regression target, alleviating the optimization difficulty and further lifting the regression performance. DAS is implemented with a fully Convolutional Neural Network and end-to-end learnable. Comprehensive experiments on benchmarks CMU Panoptic and MuPoTS-3D demonstrate the superior efficiency of the proposed DAS model, specifically 1.5x speedup over previous best model, and its stat-of-the-art accuracy for multi-person 3D pose estimation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ac0eaf19-d5d9-4324-a4ea-359e47ab11cdCited by top-tier papers6
- GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular VideoBruce X. B. Yu, Zhi Zhang, Yongxu Liu, Sheng-Hua Zhong et al.ICCV 2023 · 131 citations
- Person-in-WiFi 3D: End-to-End Multi-Person 3D Pose Estimation with Wi-FiKangwei Yan, Fei Wang, Bo Qian, Han Ding et al.CVPR 2024 · 22 citations
- Reconstructing Groups of People with Hypergraph Relational ReasoningBuzhen Huang, Jingyi Ju, Zhihao Li, Yangang WangICCV 2023 · 21 citations
- IVT: An End-to-End Instance-guided Video Transformer for 3D Pose EstimationZhongwei Qiu, Qiansheng Yang, Jian Wang, Dongmei FuACM MM 2022 · 7 citations
- SuDA: Support-based Domain Adaptation for Sim2Real Hinge Joint Tracking with Flexible SensorsJiawei Fang, Haishan Song, Chengxu Zuo, Xiaoxia Gao et al.ICML 2024 · 3 citations
Builds on12
- FCOS: Fully Convolutional One-Stage Object DetectionZhi Tian, Chunhua Shen, Hao Chen, Tong HeICCV 2019 · 6,042 citations
- Camera Distance-Aware Top-Down Approach for 3D Multi-Person Pose Estimation From a Single RGB ImageGyeongsik Moon, Ju Yong Chang, Kyoung Mu LeeICCV 2019 · 368 citations
- Human Pose Regression with Residual Log-likelihood EstimationJiefeng Li, Siyuan Bian, Ailing Zeng, Can Wang et al.ICCV 2021 · 286 citations
- XNect: real-time multi-person 3D motion capture with a single RGB cameraDushyant Mehta, Oleksandr Sotnychenko, Franziska Mueller, Weipeng Xu et al.SIGGRAPH 2020 · 267 citations
- Single-Stage Multi-Person Pose MachinesXuecheng Nie, Jiashi Feng, Jianfeng Zhang, Shuicheng YanICCV 2019 · 246 citations
Related papers
- Single-Stage is Enough: Multi-Person Absolute 3D Pose EstimationLei Jin, Chenyang Xu, Xiaojuan Wang, Yabo Xiao et al.CVPR 2022 · 40 citations
- PandaNet: Anchor-Based Single-Shot Multi-Person 3D Pose EstimationAbdallah Benzine, Florian Chabot, Bertrand Luvison, Quoc Cuong Pham et al.CVPR 2020
- Body Meshes as PointsJianfeng Zhang, Dongdong Yu, Jun Hao Liew, Xuecheng Nie et al.CVPR 2021
- Graph-Based 3D Multi-Person Pose Estimation Using Multi-View ImagesSize Wu, Sheng Jin, Wentao Liu, Lei Bai et al.ICCV 2021 · 69 citations
- Monocular, One-stage, Regression of Multiple 3D PeopleYu Sun, Qian Bao, Wu Liu, Yili Fu et al.ICCV 2021 · 335 citations
