Step-Calibrated Diffusion for Biomedical Optical Image Restoration
Yiwei Lyu, Sung Jik Cha, Cheng Jiang, Asadur Zaman Chowdury, Xinhai Hou, Edward S. Harake, Akhil Kondepudi, Christian W. Freudiger, Honglak Lee, Todd C. Hollon
Abstract
High-quality, high-resolution medical imaging is essential for clinical care. Raman-based biomedical optical imaging uses non-ionizing infrared radiation to evaluate human tissues in real time and is used for early cancer detection, brain tumor diagnosis, and intraoperative tissue analysis. Unfortunately, optical imaging is vulnerable to image degradation due to laser scattering and absorption, which can result in diagnostic errors and misguided treatment. Restoration of optical images is a challenging computer vision task because the sources of image degradation are multi-factorial, stochastic, and tissue-dependent, preventing a straightforward method to obtain paired low-quality/high-quality data. Here, we present Restorative Step-Calibrated Diffusion (RSCD), an unpaired diffusion-based image restoration method that uses a step calibrator model to dynamically determine the number of steps required to complete the reverse diffusion process for image restoration. RSCD outperforms other widely used unpaired image restoration methods on both image quality and perceptual evaluation metrics for restoring optical images. Medical imaging experts consistently prefer images restored using RSCD in blinded comparison experiments and report minimal to no hallucinations. Finally, we show that RSCD improves performance on downstream clinical imaging tasks, including automated brain tumor diagnosis and deep tissue imaging. Our code is available at https://github.com/MLNeurosurg/restorative_step-calibrated_diffusion.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on15
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential EquationsChenlin Meng, Yutong He, Yang Song, Jiaming Song et al.ICLR 2022 · 2,128 citations
Related papers
- Descanning: From Scanned to the Original Images with a Color Correction Diffusion ModelJunghun Cha, Ali Haider, Seoyun Yang, Hoeyeong Jin et al.AAAI 2024 · 4 citations
- Benchmarking Endoscopic Surgical Image Restoration and BeyondJialun Pei, Diandian Guo, Donghui Yang, Zhixi Li et al.CVPR 2026
- Taming Generative Diffusion Prior for Universal Blind Image RestorationSiwei Tu, Weidong Yang, Ben FeiNeurIPS 2024 · 6 citations
- Blind Image Restoration via Fast Diffusion InversionHamadi Chihaoui, Abdelhak Lemkhenter, Paolo FavaroNeurIPS 2024 · 46 citations
- Solving Inverse Problems with FLAIRJulius Erbach, Dominik Narnhofer, Andreas Dombos, Bernt Schiele et al.NeurIPS 2025 · 20 citations
