SyncVP: Joint Diffusion for Synchronous Multi-Modal Video Prediction

Figure 1. SyncVP is a diffusion model for synchronized multi-modal video prediction. It generates multi-modal future frames like RGB and depth for a given observation that can consist of both modalities (left) or only one modality (right).