Efficient Online Training for Zero-Shot Time-Lapse Microscopy Denoising and Super-Resolution
Ruian He, Ri Cheng, Xinkai Lyu, Weimin Tan, Bo Yan
Abstract
In time-lapse microscopy, inherent noise significantly limits imaging sensitivity and increases measurement uncertainty. Due to the scarcity of clean data, zero-shot approaches have emerged as highly data-efficient solutions for microscopy denoising. However, existing methods typically process video frames independently, resulting in long training times and issues such as temporal noise and over-smoothing. In this paper, we introduce MDSR-Zero, a zero-shot online learning method designed for plug-and-play noise suppression and super-resolution of microscopy videos. Our approach leverages an efficient online training strategy that reuses denoising models from previous frames. By treating the video as a continuous stream, our model significantly reduces training time and ensures temporally consistent denoising. Additionally, we propose a novel loss function tailored for denoising in the context of super-resolution, which enhances the detail in the denoised results. Extensive experiments on both synthetic and real-world noise demonstrate that our method achieves state-of-the-art performance among zero-shot denoising approaches and is competitive with self-supervised methods. Notably, our method can reduce training time by up to 10x compared to the previous SOTA method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cf5650f5-9ad2-4c92-a41f-3f185f03c8f0Builds on10
- Blind2Unblind: Self-Supervised Image Denoising with Visible Blind SpotsZejin Wang, Jiazheng Liu, Guoqing Li, Hua HanCVPR 2022 · 174 citations
- Unsupervised Deep Video DenoisingDev Yashpal Sheth, Sreyas Mohan, Joshua L. Vincent, Ramon Manzorro et al.ICCV 2021 · 78 citations
- Recurrent Self-Supervised Video Denoising with Denser Receptive FieldZichun Wang, Yulun Zhang, Debing Zhang, Ying FuACM MM 2023 · 15 citations
- Unsupervised Deep Video Denoising with Untrained NetworkHuan Zheng, Tongyao Pang, Hui JiAAAI 2023 · 14 citations
- Neighbor2Neighbor: Self-Supervised Denoising From Single Noisy ImagesTao Huang, Songjiang Li, Xu Jia, Huchuan Lu et al.CVPR 2021
Related papers
- Zero-shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion ModelCong Cao, Huanjing Yue, Xin Liu, Jingyu YangAAAI 2025 · 7 citations
- Meta-Transfer Learning for Zero-Shot Super-ResolutionJae Woong Soh, Sunwoo Cho, Nam Ik ChoCVPR 2020
- Zero-shot Denoising via Neural Compression: Theoretical and algorithmic frameworkAli Zafari, Xi Chen, Shirin JalaliNeurIPS 2025 · 2 citations
- Zero-Shot Noise2Noise: Efficient Image Denoising without any DataYoussef Mansour, Reinhard HeckelCVPR 2023
- Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video GeneratorsLevon Khachatryan, Andranik Movsisyan, Vahram Tadevosyan, Roberto Henschel et al.ICCV 2023 · 800 citations
