4DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videos

Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1) Gaussian 2 (t-1)

Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 2 (t+1) Gaussian 1 Gaussian 3 Veloci ty Velocity Rotation Velocit y t life-span t1 DinoV2 Dynamic Gaussian Reconstruction Figure 1: We propose a scalable 4D dynamic reconstruction model trained only on real-world monocular RGB videos. The feed-forward 4DGS (section 3.1) representation enables us to render the geometry and appearance of the dynamic scene from novel views in real-time. Even without explicit supervision, the model can learn to distinguish dynamic contents from the background and produce realistic optical flows. The figure shows an enlarged set of Gaussians for the purpose of visualization. The embedded rendered videos only play in Adobe Reader or KDE Okular.