A Characteristic Function-Based Method for Bottom-Up Human Pose Estimation
Haoxuan Qu, Yujun Cai, Lin Geng Foo, Ajay Kumar, Jun Liu
Abstract
Most recent methods formulate the task of human pose estimation as a heatmap estimation problem, and use the overall L2 loss computed from the entire heatmap to optimize the heatmap prediction. In this paper, we show that in bottom-up human pose estimation where each heatmap often contains multiple body joints, using the overall L2 loss to optimize the heatmap prediction may not be the optimal choice. This is because, minimizing the overall L2 loss cannot always lead the model to locate all the body joints across different sub-regions of the heatmap more accurately. To cope with this problem, from a novel perspective, we propose a new bottom-up human pose estimation method that optimizes the heatmap prediction via minimizing the distance between two characteristic functions respectively constructed from the predicted heatmap and the groundtruth heatmap. Our analysis presented in this paper indicates that the distance between these two characteristic functions is essentially the upper bound of the L2 losses w.r.t. sub-regions of the predicted heatmap. Therefore, via minimizing the distance between the two characteristic functions, we can optimize the model to provide a more accurate localization result for the body joints in different sub-regions of the predicted heatmap. We show the effectiveness of our proposed method through extensive experiments on the COCO dataset and the CrowdPose dataset.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d90b3dde-75e2-443a-a6dc-545f1b3b5affBuilds on19
- Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot ClassificationJiangtao Xie, Fei Long, Jiaming Lv, Qilong Wang et al.CVPR 2022 · 270 citations
- Single-Stage Multi-Person Pose MachinesXuecheng Nie, Jiashi Feng, Jianfeng Zhang, Shuicheng YanICCV 2019 · 246 citations
- Pose-Aware Multi-Level Feature Network for Human Object Interaction DetectionBo Wan, Desen Zhou, Yongfei Liu, Rongjie Li et al.ICCV 2019 · 224 citations
- End-to-End Multi-Person Pose Estimation with TransformersDahu Shi, Xing Wei, Liangqi Li, Ye Ren et al.CVPR 2022 · 147 citations
- Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose EstimationJia Li, Wen Su, Zengfu WangAAAI 2020 · 104 citations
Related papers
- Heatmap Distribution Matching for Human Pose EstimationHaoxuan Qu, Li Xu, Yujun Cai, Lin Geng Foo et al.NeurIPS 2022 · 25 citations
- Rethinking the Heatmap Regression for Bottom-Up Human Pose EstimationZhengxiong Luo, Zhicheng Wang, Yan Huang, Liang Wang et al.CVPR 2021
- Learning Local-Global Contextual Adaptation for Multi-Person Pose EstimationNan Xue, Tianfu Wu, Gui-Song Xia, Liangpei ZhangCVPR 2022 · 42 citations
- Lightweight Super-Resolution Head for Human Pose EstimationHaonan Wang, Jie Liu, Jie Tang, Gangshan WuACM MM 2023 · 23 citations
- Continuous Heatmap Regression for Pose Estimation via Implicit Neural RepresentationShengxiang Hu, Huaijiang Sun, Dong Wei, Xiaoning Sun et al.NeurIPS 2024 · 5 citations
