Real-Time Simulated Avatar from Head-Mounted Sensors

https://zhengyiluo.github.io/SimXR/ Figure 1. Avatar control using SimXR on real world AR/VR headsets. (Left): An indoor kitchen setting using AR headset. SimXR controls the humanoid using headset pose and visual input from two front-facing cameras. (Right): An office setting using VR headset (Quest 2). Humanoid motion is driven by the headset pose, two side-facing and two up-facing cameras.