High-resolution image reconstruction with latent diffusion models from human brain activity
Yu Takagi, Shinji Nishimoto
2023Year
114Top-tier citations
Abstract
forward fashion, without the need for any additional training and fine-tuning of complex deep-learning models. We also provide a quantitative interpretation of different LDM components from a neuroscientific perspective. Overall, our study proposes a promising method for reconstructing images from human brain activity, and provides a new framework for understanding DMs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b030e356-aa05-4f65-9edb-01a7302624b3Cited by top-tier papers114
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann et al.ICLR 2024 · 4,569 citations
- Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion PriorsPaul S. Scotti, Atmadeep Banerjee, Jimmie Goode, Stepan Shabalin et al.NeurIPS 2023 · 282 citations
- Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion ModelsLitu Rout, Negin Raoof, Giannis Daras, Constantine Caramanis et al.NeurIPS 2023 · 193 citations
- Visual Decoding and Reconstruction via EEG Embeddings with Guided DiffusionDongyang Li, Chen Wei, Shiying Li, Jiachen Zou et al.NeurIPS 2024 · 164 citations
- Decoding Natural Images from EEG for Object RecognitionYonghao Song, Bingchuan Liu, Xiang Li, Nanlin Shi et al.ICLR 2024 · 135 citations
Builds on10
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
Related papers
- BrainRAM: Cross-Modality Retrieval-Augmented Image Reconstruction from Human Brain ActivityDian Xie, Peiang Zhao, Jiarui Zhang, Kangqi Wei et al.ACM MM 2024 · 7 citations
- Conditional Generative Neural Decoding with Structured CNN Feature PredictionChangde Du, Changying Du, Lijie Huang, Huiguang HeAAAI 2020 · 14 citations
- Contrast, Attend and Diffuse to Decode High-Resolution Images from Brain ActivitiesJingyuan Sun, Mingxiao Li, Zijiao Chen, Yunhao Zhang et al.NeurIPS 2023 · 57 citations
- Generating Content for HDR Deghosting from Frequency ViewTao Hu, Qingsen Yan, Yuankai Qi, Yanning ZhangCVPR 2024
- Towards Interpretable Visual Decoding with Attention to Brain RepresentationsPinyuan Feng, Hossein Adeli, Wenxuan Guo, Fan Cheng et al.ICLR 2026 · 1 citation
