Decoupling Human and Camera Motion from Videos in the Wild

Human Motion in the World Frame Figure 1. 4D Reconstruction of People from Videos in-the-Wild. We present SLAHMR: Simultaneous Localization And Human Mesh Recovery, a method that given a video of moving people (top), recovers the global trajectories of all people and cameras in the world coordinate space (bottom). We combine geometric insights, which determine relative camera motion, with learned human motion priors, which constrain a person's plausible displacement between frames, to position the people and cameras in the shared world frame through time. Our method can recover the global trajectories of all detected people from in-the-wild videos with uncontrolled camera and human motion. Please see the project page to see the full video results.