A Wiener Process Perspective on Local Intrinsic Dimension Estimation Methods
Piotr Tempczyk, Lukasz Garncarek, Dominik Filipiak, Adam Kurpisz
Abstract
Local intrinsic dimension (LID) estimation methods have received a lot of attention in recent years thanks to the progress in deep neural networks and generative modeling. In opposition to old non-parametric methods, new methods use generative models to approximate diffused dataset density to scale the methods to high-dimensional datasets (e.g. images). In this paper, we investigate the recent state-of-the-art parametric LID estimation methods from the perspective of the Wiener process. We explore how these methods behave when their assumptions are not met. We give an extended mathematical description of those methods and their error as a function of the probability density of the data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 248a0236-b082-4c0f-bc9e-be4c1f502b6dCited by top-tier papers3
- A Geometric View of Data Complexity: Efficient Local Intrinsic Dimension Estimation with Diffusion ModelsHamidreza Kamkari, Brendan Leigh Ross, Rasa Hosseinzadeh, Jesse C. Cresswell et al.NeurIPS 2024 · 49 citations
- Why We Need New Benchmarks for Local Intrinsic Dimension EstimationPiotr Tempczyk, Dominik Filipiak, Lukasz Garncarek, Ksawery Smoczynski et al.ICLR 2026
- Local Hessian Spectral Filtering for Robust Intrinsic Dimension EstimationGenki OsadaICML 2026
Builds on6
- The Intrinsic Dimension of Images and Its Impact on LearningPhillip Pope, Chen Zhu, Ahmed Abdelkader, Micah Goldblum et al.ICLR 2021 · 381 citations
- Diffusion Models Encode the Intrinsic Dimension of Data ManifoldsJan Stanczuk, Georgios Batzolis, Teo Deveney, Carola-Bibiane SchönliebICML 2024 · 53 citations
- LIDL: Local Intrinsic Dimension Estimation Using Approximate LikelihoodPiotr Tempczyk, Rafal Michaluk, Lukasz Garncarek, Przemyslaw Spurek et al.ICML 2022 · 39 citations
- Intrinsic dimensionality estimation using Normalizing FlowsChristian Horvat, Jean-Pascal PfisterNeurIPS 2022 · 20 citations
- On gauge freedom, conservativity and intrinsic dimensionality estimation in diffusion modelsChristian Horvat, Jean-Pascal PfisterICLR 2024 · 19 citations
Related papers
- A Geometric Explanation of the Likelihood OOD Detection ParadoxHamidreza Kamkari, Brendan Leigh Ross, Jesse C. Cresswell, Anthony L. Caterini et al.ICML 2024 · 20 citations
- Feature Likelihood Score: Evaluating the Generalization of Generative Models Using SamplesMarco Jiralerspong, Avishek Joey Bose, Ian Gemp, Chongli Qin et al.NeurIPS 2023 · 39 citations
- Interpreting and Improving Diffusion Models from an Optimization PerspectiveFrank Permenter, Chenyang YuanICML 2024 · 16 citations
- Intrinsic Dimension, Persistent Homology and Generalization in Neural NetworksTolga Birdal, Aaron Lou, Leonidas J. Guibas, Umut SimsekliNeurIPS 2021 · 94 citations
- Understanding Failures in Out-of-Distribution Detection with Deep Generative ModelsLily H. Zhang, Mark Goldstein, Rajesh RanganathICML 2021 · 129 citations
