EigenScore: OOD Detection using Posterior Covariance in Diffusion Models
Shirin Shoushtari, Yi Wang, Xiao Shi, M. Salman Asif, Ulugbek Kamilov
摘要
Out-of-distribution (OOD) detection is critical for the safe deployment of machine learning systems in safety-sensitive domains. Diffusion models have recently emerged as powerful generative models, capable of capturing complex data distributions through iterative denoising. Building on this progress, recent work has explored their potential for OOD detection. We propose EigenScore, a new OOD detection method that leverages the eigenvalue spectrum of the posterior covariance induced by a diffusion model. We argue that posterior covariance provides a consistent signal of distribution shift, leading to larger trace and leading eigenvalues on OOD inputs, yielding a clear spectral signature. We further provide analysis explicitly linking posterior covariance to distribution mismatch, establishing it as a reliable signal for OOD detection. To ensure tractability, we adopt a Jacobian-free subspace iteration method to estimate the leading eigenvalues using only forward evaluations of the denoiser. Empirically, EigenScore achieves state-of-the-art performance, with up to 2% AUROC improvement over the best baseline. Notably, it remains robust in near-OOD settings such as CIFAR-10 vs CIFAR-100, where existing diffusion-based methods often fail.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- EigenCache: Rethinking Diffusion Acceleration as Covariance-Optimal Forecasting and Submodular Information AllocationChenyang Xu, Dezhen Wang, Lin Chen, Kepeng Lin 等ICML 2026
- KLIP: Localized Distribution Shift Detection via KL-Divergence with Diffusion Priors in Inverse ProblemsAlireza Kheirandish, Jihoon Hong, Sara Fridovich-KeilCVPR 2026
它引用的顶会 Paper28
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 被引用 3,959 次
- Energy-based Out-of-distribution DetectionWeitang Liu, Xiaoyun Wang, John D. Owens, Yixuan LiNeurIPS 2020 · 被引用 2,213 次
相关 Paper
- SCOPED: Score-Curvature Out-of-distribution Proximity Evaluator for DiffusionBrett Barkley, Preston Culbertson, David Fridovich-KeilICLR 2026 · 被引用 4 次
- Unsupervised Out-of-Distribution Detection with Diffusion InpaintingZhenzhen Liu, Jin Peng Zhou, Yufan Wang, Kilian Q. WeinbergerICML 2023 · 被引用 66 次
- Input Complexity and Out-of-distribution Detection with Likelihood-based Generative ModelsJoan Serrà, David Álvarez, Vicenç Gómez, Olga Slizovskaia 等ICLR 2020 · 被引用 307 次
- GEPC: Group-Equivariant Posterior Consistency for Out-of-Distribution Detection in Diffusion ModelsRouzoumka Yadang Alexis, Jean Pinsolle, Eugénie TERREAUX, christele morisseau 等ICML 2026 · 被引用 1 次
- Diffusion-based Layer-wise Semantic Reconstruction for Unsupervised Out-of-Distribution DetectionYing Yang, De Cheng, Chaowei Fang, Yubiao Wang 等NeurIPS 2024 · 被引用 9 次
