EchoMotion: Towards Full-Body Pose Tracking with a Single Smartwatch Using Active Acoustic Sensing
Saif Mahmud, Jiwan Kim, Tianhong Catherine Yu, Qikang Liang, Vineet A. Parikh, Francois Guimbretiere, Cheng Zhang
摘要
Full-body pose tracking on wearables enables fitness tracking, rehabilitation, and activity logging on the go, but remains challenging as it requires capturing movements across the torso, arms, legs, and head. Existing solutions often rely on specialized suits or multiple sensors, limiting practicality. We present EchoMotion, an active acoustic sensing system that enables full-body pose tracking using only a wrist-worn smartwatch. By leveraging the built-in speaker and microphone to emit inaudible ultrasonic signals and process their reflections, EchoMotion employs a lightweight deep learning pipeline to infer the 3D positions of 12 body joints. We first validated the approach with 10 participants using a custom hardware prototype, achieving a mean per-joint position error (MPJPE) of 5.36 cm and rotation error (MPJRE) of 11.68°. We then confirmed feasibility with 15 participants on a commercial smartwatch (MPJPE 5.99 cm, MPJRE 11.92°). Finally, in a semi-in-the-wild study with 10 participants, EchoMotion maintained comparable performance (MPJPE 6.41 cm, MPJRE 13.18°), suggesting its potential for future real-world use.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a WristbandChi-Jung Lee, Ruidong Zhang, Devansh Agarwal, Tianhong Catherine Yu 等CHI 2024 · 被引用 48 次
- WatchHand: Enabling Continuous Hand Pose Tracking On Off-the-Shelf SmartwatchesJiwan Kim, Chi-Jung Lee, Hohurn Jung, Tianhong Catherine Yu 等CHI 2026 · 被引用 3 次
- BodyTrak: Inferring Full-body Poses from Body Silhouettes Using a Miniature Camera on a WristbandHyunchul Lim, Yaxuan Li, Matthew Dressa, Fang Hu 等UbiComp 2022 · 被引用 18 次
- PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on SmartglassesSaif Mahmud, Ke Li, Guilin Hu, Hao Chen 等UbiComp 2023 · 被引用 31 次
- UltraPoser: Pushing the Limits of IMU-based Full-Body Pose Estimation with Ultrasound Sensing on Consumer WearablesYadong Li, Shuning Wang, Yongjian Fu, Justin Chen 等UIST 2025 · 被引用 2 次
