Localizing Memorized Regions in Diffusion Models via Coordinate-Wise Curvature Differences
Gwangho Kim, Sungyoon Lee
摘要
Diffusion models can unintentionally memorize training samples, raising concerns about privacy and copyright. While recent methods can detect memorization, they often rely on global or model-specific signals and provide limited insight into where memorization appears within a generated image. We provide a geometric characterization of local memorization as a coordinate-wise variance collapse. However, such collapse can also arise from intrinsic data constraints rather than overfitting. To isolate overfitting-driven memorization, we propose curvature-difference methods that subtract the curvature of an underfitted baseline, either the unconditional model or a less-trained version of itself. We further derive a score-difference proxy that provides a geometric explanation for the widely used score-difference-based detection metric. Experiments on Stable Diffusion, evaluated against ground-truth memorization masks, show that our method outperforms the prior attention-based localization method. Code is available at https://github.com/Gwangho99/mem-curv-diff.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper22
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Guiding a Diffusion Model with a Bad Version of ItselfTero Karras, Miika Aittala, Tuomas Kynkäänniemi, Jaakko Lehtinen 等NeurIPS 2024 · 被引用 338 次
相关 Paper
- Detecting and Mitigating Memorization in Diffusion Models through Anisotropy of the Log-ProbabilityRohan Asthana, Vasileios BelagiannisICLR 2026 · 被引用 3 次
- Broken Memories: Detecting and Mitigating Memorization in Diffusion Models with Degraded GenerationsYuanmin Huang, Mi Zhang, Chen Chen, Feifei Li 等KDD 2026
- Exploring Local Memorization in Diffusion Models via Bright Ending AttentionChen Chen, Daochang Liu, Mubarak Shah, Chang XuICLR 2025
- Latent Diffusion Inversion Requires Understanding the Latent SpaceMingxing Rao, Bowen Qu, Daniel MoyerCVPR 2026 · 被引用 4 次
- Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability LandscapesDongjae Jeon, Dueun Kim, Albert NoICML 2025
