MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

delity for each other. Extensive experiments show superior results in unconditional audio-video generation, and zero-shot conditional tasks (e.g., video-to-audio). In particular, we achieve the best FVD and FAD on Landscape and AIST++ dancing datasets. Turing tests of 10k votes further demonstrate dominant preferences for our model. The code and pre-trained models can be downloaded at https: //github.com/researchmm/MM-Diffusion.