Revisiting flow generative models for Out-of-distribution detection
Dihong Jiang, Sun Sun, Yaoliang Yu
Abstract
Deep generative models have been widely used in practical applications such as the detection of out-of-distribution (OOD) data. In this work, we aim to re-examine the potential of generative flow models in OOD detection. We first propose a simple combination of univariate one-sample statistical test (e.g., Kolmogorov-Smirnov) and random projections in the latent space of flow models to perform OOD detection. Then, we propose a two-sample version of our test to account for imperfect flow models. Quite distinctly, our method does not pose parametric assumptions on OOD data and is capable of exploiting any flow model. Experimentally, firstly we confirm the efficacy of our method against state-of-the-art baselines through extensive experiments on several image datasets; secondly we investigate the relationship between model accuracy (e.g., the generation quality) and the OOD detection performance, and found surprisingly that they are not always positively correlated; and thirdly we show that detection in the latent space of flow models generally outperforms detection in the sample space across various OOD datasets, hence highlighting the benefits of training a flow model.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 5fc25503-6beb-4e51-8cca-e87ab34f2ecaCited by top-tier papers17
- RankFeat: Rank-1 Feature Removal for Out-of-distribution DetectionYue Song, Nicu Sebe, Wei WangNeurIPS 2022 · 76 citations
- Not All Out-of-Distribution Data Are Harmful to Open-Set Active LearningYang Yang, Yuxuan Zhang, Xin Song, Yi XuNeurIPS 2023 · 48 citations
- Neuron Activation Coverage: Rethinking Out-of-distribution Detection and GeneralizationYibing Liu, Chris Xing Tian, Haoliang Li, Lei Ma et al.ICLR 2024 · 28 citations
- Out-of-Distribution Detection with An Adaptive Likelihood Ratio on Informative Hierarchical VAEYewen Li, Chaojie Wang, Xiaobo Xia, Tongliang Liu et al.NeurIPS 2022 · 26 citations
- Anomaly Detection with Score Distribution DiscriminationMinqi Jiang, Songqiao Han, Hailiang HuangKDD 2023 · 17 citations
Related papers
- Why Normalizing Flows Fail to Detect Out-of-Distribution DataPolina Kirichenko, Pavel Izmailov, Andrew Gordon WilsonNeurIPS 2020 · 370 citations
- Understanding Failures in Out-of-Distribution Detection with Deep Generative ModelsLily H. Zhang, Mark Goldstein, Rajesh RanganathICML 2021 · 129 citations
- Locally Most Powerful Bayesian Test for Out-of-Distribution Detection using Deep Generative ModelsKeunseo Kim, Juncheol Shin, Heeyoung KimNeurIPS 2021 · 23 citations
- Advancing Out-of-Distribution Detection via Local NeuroplasticityAlessandro Canevaro, Julian Schmidt, Mohammad Sajad Marvi, Hang Yu et al.ICLR 2025
- Out-of-Distribution Detection with a Single Unconditional Diffusion ModelAlvin Heng, Alexandre H. Thiery, Harold SohNeurIPS 2024 · 35 citations
