Generative Diffusion Priors for 3D Mapping of the Dark Universe
Brandon Zhao, Diana Scognamiglio, Olivier Doré, Katherine L. Bouman
Abstract
Reconstructing the three-dimensional distribution of dark matter from weak-lensing observations is a central but highly ill-posed inverse problem in cosmology. Unlike standard 3D reconstruction with multiple viewpoints, we observe the universe from a single line of sight, through noisy shape distortions of galaxies with uncertain distances, so meaningful recovery of the 3D matter field requires strong prior assumptions. Existing methods either produce point estimates with handcrafted priors or use neural ensembles for approximate Bayesian uncertainty, and struggle to capture the non-Gaussian, filamentary structure of the cosmic web. With the advent of new high-resolution cosmological simulations, we now have an alternative source of prior knowledge that captures the nonlinear statistics of structure formation with far greater fidelity than analytic prescriptions. We leverage these simulations to build a new dataset , which enables us to learn a data-driven diffusion-model prior capturing the full 3D distribution of dark matter structure across cosmic time. Building on recent plug-and-play approaches, we modify a diffusion-based posterior sampling scheme to the 3D weak-lensing setting, combining the learned prior with a differentiable physical forward model. On realistic simulations targeting a modern weak lensing survey, our approach yields substantially improved 2D and 3D reconstruction accuracy over baseline methods. Moreover, it produces posterior samples whose statistics closely track the underlying simulations, while remaining robust to moderate shifts in cosmology.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Diffusion Posterior Sampling for General Noisy Inverse ProblemsHyungjin Chung, Jeongsol Kim, Michael Thompson McCann, Marc Louis Klasky et al.ICLR 2023 · 152 citations
- Single View Refractive Index Tomography with Neural FieldsBrandon Zhao, Aviad Levis, Liam Connor, Pratul P. Srinivasan et al.CVPR 2024 · 4 citations
- Improving Diffusion Inverse Problem Solving with Decoupled Noise AnnealingBingliang Zhang, Wenda Chu, Julius Berner, Chenlin Meng et al.CVPR 2025
- Revealing the 3D Cosmic Web through Gravitationally Constrained Neural FieldsBrandon Zhao, Aviad Levis, Liam Connor, Pratul P. Srinivasan et al.ICLR 2025
- InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical SciencesHongkai Zheng, Wenda Chu, Bingliang Zhang, Zihui Wu et al.ICLR 2025
Related papers
- Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse ViewsZixin Zou, Weihao Cheng, Yan-Pei Cao, Shi-Sheng Huang et al.AAAI 2024 · 34 citations
- Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play PriorsZihui Wu, Yu Sun, Yifan Chen, Bingliang Zhang et al.NeurIPS 2024 · 128 citations
- Divide-and-Conquer Posterior Sampling for Denoising Diffusion priorsYazid Janati, Badr Moufad, Alain Durmus, Eric Moulines et al.NeurIPS 2024 · 34 citations
- Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse ViewsSongchun Zhang, Chunhui ZhaoAAAI 2025
- DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion ModelsJamie Wynn, Daniyar TurmukhambetovCVPR 2023
