Real-Time Simulated Avatar from Head-Mounted Sensors

Zhengyi Luo; Jinkun Cao; Rawal Khirodkar; Alexander Winkler; Jing Huang; Kris Kitani; Weipeng Xu

doi:10.1109/cvpr52733.2024.00061

CVPR2024顶会

Real-Time Simulated Avatar from Head-Mounted Sensors

Zhengyi Luo, Jinkun Cao, Rawal Khirodkar, Alexander Winkler, Jing Huang, Kris Kitani, Weipeng Xu

DOI 出版方

2024年份

14顶会引用

摘要

https://zhengyiluo.github.io/SimXR/ Figure 1. Avatar control using SimXR on real world AR/VR headsets. (Left): An indoor kitchen setting using AR headset. SimXR controls the humanoid using headset pose and visual input from two front-facing cameras. (Right): An office setting using VR headset (Quest 2). Humanoid motion is driven by the headset pose, two side-facing and two up-facing cameras.