CVPR2023

Listening Human Behavior: 3D Human Pose Estimation with Acoustic Signals

Yuto Shibata, Yutaka Kawashima, Mariko Isogawa, Go Irie, Akisato Kimura, Yoshimitsu Aoki

Abstract

Figure 1. We propose 3D human pose estimation given only low-level acoustic signals with a single pair of microphones and loudspeakers. Given an audio feature frame (right-middle), our method estimates 3D human pose sequences (right-bottom).