Cryptographic Hardness of Score Estimation
Min Jae Song
Abstract
We show that -accurate score estimation, in the absence of strong assumptions on the data distribution, is computationally hard even when sample complexity is polynomial in the relevant problem parameters. Our reduction builds on the result of Chen et al. (ICLR 2023), who showed that the problem of generating samples from an unknown data distribution reduces to -accurate score estimation. Our hard-to-estimate distributions are the"Gaussian pancakes"distributions, originally due to Diakonikolas et al. (FOCS 2017), which have been shown to be computationally indistinguishable from the standard Gaussian under widely believed hardness assumptions from lattice-based cryptography (Bruna et al., STOC 2021; Gupte et al., FOCS 2022).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on19
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Diffusion Schrödinger Bridge with Applications to Score-Based Generative ModelingValentin De Bortoli, James Thornton, Jeremy Heng, Arnaud DoucetNeurIPS 2021 · 811 citations
- Convergence for score-based generative modeling with polynomial complexityHolden Lee, Jianfeng Lu, Yixin TanNeurIPS 2022 · 221 citations
Related papers
- Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional DataMinshuo Chen, Kaixuan Huang, Tuo Zhao, Mengdi WangICML 2023 · 168 citations
- High-accuracy sampling for diffusion models and log-concave distributionsFan Chen, Sinho Chewi, Constantinos Daskalakis, Alexander RakhlinICML 2026 · 12 citations
- Continuous LWE is as Hard as LWE & Applications to Learning Gaussian MixturesAparna Gupte, Neekon Vafa, Vinod VaikuntanathanFOCS 2022 · 15 citations
- Learning (Very) Simple Generative Models Is HardSitan Chen, Jerry Li, Yuanzhi LiNeurIPS 2022 · 12 citations
- Approximation and Generalization Abilities of Score-based Neural Network Generative Models for Sub-Gaussian DistributionsGuoji Fu, Wee Sun LeeNeurIPS 2025 · 1 citation
