Probability Density Geodesics in Image Diffusion Latent Space
Qingtao Yu, Jaskirat Singh, Zhaoyuan Yang, Peter Henry Tu, Jing Zhang, Hongdong Li, Richard I. Hartley, Dylan Campbell
摘要
Diffusion models indirectly estimate the probability density over a data space, which can be used to study its structure. In this work, we show that geodesics can be computed in diffusion latent space, where the norm induced by the spatially-varying inner product is inversely proportional to the probability density. In this formulation, a path that traverses a high density (that is, probable) region of image latent space is shorter than the equivalent path through a low density region. We present algorithms for solving the associated initial and boundary value problems and show how to compute the probability density along the path and the geodesic distance between two points. Using these techniques, we analyze how closely video clips approximate geodesics in a pre-trained image diffusion space. Finally, we demonstrate how these techniques can be applied to training-free image sequence interpolation and extrapolation, given a pre-trained image diffusion model.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- The Spacetime of Diffusion Models: An Information Geometry PerspectiveRafal Karczewski, Markus Heinonen, Alison Pouplin, Søren Hauberg 等ICLR 2026 · 被引用 7 次
- GeodesicNVS: Probability Density Geodesic Flow Matching for Novel View SynthesisXuqin Wang, Tao Wu, Yanfeng Zhang, Lu Liu 等CVPR 2026 · 被引用 4 次
- Vibe Spaces for Creatively Connecting and Expressing Visual ConceptsHuzheng Yang, Katherine Xu, Andrew Lu, Michael D. Grossberg 等CVPR 2026 · 被引用 4 次
它引用的顶会 Paper27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
相关 Paper
- Efficient Video Diffusion Models via Content-Frame Motion-Latent DecompositionSihyun Yu, Weili Nie, De-An Huang, Boyi Li 等ICLR 2024 · 被引用 34 次
- Warped Diffusion: Solving Video Inverse Problems with Image Diffusion ModelsGiannis Daras, Weili Nie, Karsten Kreis, Alex Dimakis 等NeurIPS 2024 · 被引用 25 次
- Frame Interpolation with Consecutive Brownian Bridge DiffusionZonglin Lyu, Ming Li, Jianbo Jiao, Chen ChenACM MM 2024 · 被引用 7 次
- Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based ModelsLouis Béthune, David Vigouroux, Yilun Du, Rufin VanRullen 等NeurIPS 2025 · 被引用 8 次
- A Mixture-Based Framework for Guiding Diffusion ModelsYazid Janati, Badr Moufad, Mehdi Abou El Qassime, Alain Oliviero Durmus 等ICML 2025
