Unsupervised Deep Learning for Phase Retrieval via Teacher-Student Distillation
Yuhui Quan, Zhile Chen, Tongyao Pang, Hui Ji
Abstract
Phase retrieval (PR) is a challenging nonlinear inverse problem in scientific imaging that involves reconstructing the phase of a signal from its intensity measurements. Recently, there has been an increasing interest in deep learning-based PR. However, collecting ground-truth (GT) images are challenging in many domains, which motivates us to study an unsupervised learning approach for PR. This approach trains a end-to-end deep model without any GT image via a teacherstudent online distillation framework. Specifically, a teacher model is trained using a self-expressive loss with noise resistance, while a student model is trained with a consistency loss on augmented data to improve the teacher's dark knowledge. Additionally, we develop an enhanced unfolding network for both the teacher and student models. Extensive experiments show that our proposed approach outperforms existing unsupervised PR methods with higher computational efficiency and performs competitively against supervised methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9716ca66-b92f-4f49-9a6c-17c6d1c63896Cited by top-tier papers2
- Unsupervised Deep Unrolling Networks for Phase UnwrappingZhile Chen, Yuhui Quan, Hui JiCVPR 2024
- Ground-Truth Free Meta-Learning for Deep Compressive SamplingXinran Qin, Yuhui Quan, Tongyao Pang, Hui JiCVPR 2023
Builds on9
- Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep LearningZeyuan Allen-Zhu, Yuanzhi LiICLR 2023 · 151 citations
- Memory-Augmented Deep Unfolding Network for Compressive SensingJiechong Song, Bin Chen, Jian ZhangACM MM 2021 · 117 citations
- Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging ProblemsKaixuan Wei, Angelica I. Avilés-Rivero, Jingwei Liang, Ying Fu et al.ICML 2020 · 114 citations
- Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational ImagingHe Sun, Katherine L. BoumanAAAI 2021 · 82 citations
- Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative PriorsZhaoqiang Liu, Subhroshekhar Ghosh, Jonathan ScarlettNeurIPS 2021 · 22 citations
Related papers
- Physics-Based Iterative Projection Complex Neural Network for Phase Retrieval in Lensless Microscopy ImagingFeilong Zhang, Xianming Liu, Cheng Guo, Shiyi Lin et al.CVPR 2021
- Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurementsDongdong Chen, Julián Tachella, Mike E. DaviesCVPR 2022 · 51 citations
- Self-supervised Deep Image Restoration via Adaptive Stochastic Gradient Langevin DynamicsWeixi Wang, Ji Li, Hui JiCVPR 2022 · 18 citations
- End-to-end reconstruction meets data-driven regularization for inverse problemsSubhadip Mukherjee, Marcello Carioni, Ozan Öktem, Carola-Bibiane SchönliebNeurIPS 2021 · 54 citations
- When deep denoising meets iterative phase retrievalYaotian Wang, Xiaohang Sun, Jason W. FleischerICML 2020 · 22 citations
