EchoMotion: Towards Full-Body Pose Tracking with a Single Smartwatch Using Active Acoustic Sensing
Saif Mahmud, Jiwan Kim, Tianhong Catherine Yu, Qikang Liang, Vineet A. Parikh, Francois Guimbretiere, Cheng Zhang
Abstract
Full-body pose tracking on wearables enables fitness tracking, rehabilitation, and activity logging on the go, but remains challenging as it requires capturing movements across the torso, arms, legs, and head. Existing solutions often rely on specialized suits or multiple sensors, limiting practicality. We present EchoMotion, an active acoustic sensing system that enables full-body pose tracking using only a wrist-worn smartwatch. By leveraging the built-in speaker and microphone to emit inaudible ultrasonic signals and process their reflections, EchoMotion employs a lightweight deep learning pipeline to infer the 3D positions of 12 body joints. We first validated the approach with 10 participants using a custom hardware prototype, achieving a mean per-joint position error (MPJPE) of 5.36 cm and rotation error (MPJRE) of 11.68°. We then confirmed feasibility with 15 participants on a commercial smartwatch (MPJPE 5.99 cm, MPJRE 11.92°). Finally, in a semi-in-the-wild study with 10 participants, EchoMotion maintained comparable performance (MPJPE 6.41 cm, MPJRE 13.18°), suggesting its potential for future real-world use.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get dee8bf28-f25b-4649-9cd0-9839a864ea31Related papers
- EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a WristbandChi-Jung Lee, Ruidong Zhang, Devansh Agarwal, Tianhong Catherine Yu et al.CHI 2024 · 48 citations
- WatchHand: Enabling Continuous Hand Pose Tracking On Off-the-Shelf SmartwatchesJiwan Kim, Chi-Jung Lee, Hohurn Jung, Tianhong Catherine Yu et al.CHI 2026 · 3 citations
- BodyTrak: Inferring Full-body Poses from Body Silhouettes Using a Miniature Camera on a WristbandHyunchul Lim, Yaxuan Li, Matthew Dressa, Fang Hu et al.UbiComp 2022 · 18 citations
- PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on SmartglassesSaif Mahmud, Ke Li, Guilin Hu, Hao Chen et al.UbiComp 2023 · 31 citations
- UltraPoser: Pushing the Limits of IMU-based Full-Body Pose Estimation with Ultrasound Sensing on Consumer WearablesYadong Li, Shuning Wang, Yongjian Fu, Justin Chen et al.UIST 2025 · 2 citations
