From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Models

Figure 1. We introduce Rolling Prediction Model, an approach that generates smooth and realistic full-body human motion in the two of the most common XR sensing signals: hand controllers, in which the tracking signal is always available (left), and hand tracking, in which the tracking signal is noisy and might be lost for long periods of time (right). Tracking input trajectories are shown as magenta lines.