Geometric Decoupling: Diagnosing the Structural Instability of Latent
Yuanbang Liang, Zhengwen Chen, Yu-Kun Lai
摘要
Latent Diffusion Models (LDMs) achieve high-fidelity synthesis but suffer from latent space brittleness, causing discontinuous semantic jumps during editing. We introduce a Riemannian framework to diagnose this instability by analyzing the generative Jacobian, decomposing geometry into Local Scaling (capacity) and Local Complexity (curvature). Our study uncovers a "Geometric Decoupling" : while curvature in normal generation functionally encodes image detail, Out-of-Distribution (OOD) generation exhibits a functional decoupling where extreme curvature is wasted on unstable semantic boundaries rather than perceptible details. This geometric misallocation identifies "Geometric Hotspots" as the structural root of instability, providing a robust intrinsic metric for diagnosing generative reliability. Our code is at https://github.com/Byronliang8/Diffusion-Geometry.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper26
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann 等ICLR 2024 · 被引用 4,569 次
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 等ICML 2024 · 被引用 3,620 次
- Understanding Dimensional Collapse in Contrastive Self-supervised LearningLi Jing, Pascal Vincent, Yann LeCun, Yuandong TianICLR 2022 · 被引用 467 次
相关 Paper
- Isometric Representation Learning for Disentangled Latent Space of Diffusion ModelsJaehoon Hahm, Junho Lee, Sunghyun Kim, Joonseok LeeICML 2024 · 被引用 21 次
- Understanding the Latent Space of Diffusion Models through the Lens of Riemannian GeometryYong-Hyun Park, Mingi Kwon, Jaewoong Choi, Junghyo Jo 等NeurIPS 2023 · 被引用 163 次
- Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusionEnrico Ventura, Beatrice Achilli, Gianluigi Silvestri, Carlo Lucibello 等ICLR 2025
- Localizing Memorized Regions in Diffusion Models via Coordinate-Wise Curvature DifferencesGwangho Kim, Sungyoon LeeICML 2026
- GPLD3D: Latent Diffusion of 3D Shape Generative Models by Enforcing Geometric and Physical PriorsYuan Dong, Qi Zuo, Xiaodong Gu, Weihao Yuan 等CVPR 2024
