FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesis

Single image Camera parameters … Optical flow maps Figure 1. (Left) Our method using optical flow enables video synthesis with complex camera movements (dolly zoom). (Right) Synthesized video frames with 'zoom-out' camera motion. X-t slice reveals pixel value changes along the red line. Our method shows natural object motion and accurate camera control, while CameraCtrl [9] produces an object without motions, and MotionCtrl [33] produces artifacts.