Novel View Synthesis of Dynamic Scenes With Globally Coherent Depths From a Monocular Camera

Figure 1: Dynamic Scene View Synthesis: (Left) A dynamic scene is captured from a monocular camera from the locations V 0 to V k . Each image captures people jumping at each time step (t = 0 to t = k). (Middle) A novel view from an arbitrary location between V 0 and V 1 (denoted as an orange frame) is synthesized with the dynamic contents observed at the time t = k. The estimated depth at V k is shown in the inset. (Right) For the novel view (orange frame), we can also synthesize the dynamic content that appeared across any views in different time (traces of the foreground in each time step are shown). More results are shown in Sec. 5 and the supplementary document and video.