Unsupervised Deep Learning for Phase Retrieval via Teacher-Student Distillation
Yuhui Quan, Zhile Chen, Tongyao Pang, Hui Ji
摘要
Phase retrieval (PR) is a challenging nonlinear inverse problem in scientific imaging that involves reconstructing the phase of a signal from its intensity measurements. Recently, there has been an increasing interest in deep learning-based PR. However, collecting ground-truth (GT) images are challenging in many domains, which motivates us to study an unsupervised learning approach for PR. This approach trains a end-to-end deep model without any GT image via a teacherstudent online distillation framework. Specifically, a teacher model is trained using a self-expressive loss with noise resistance, while a student model is trained with a consistency loss on augmented data to improve the teacher's dark knowledge. Additionally, we develop an enhanced unfolding network for both the teacher and student models. Extensive experiments show that our proposed approach outperforms existing unsupervised PR methods with higher computational efficiency and performs competitively against supervised methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Unsupervised Deep Unrolling Networks for Phase UnwrappingZhile Chen, Yuhui Quan, Hui JiCVPR 2024
- Ground-Truth Free Meta-Learning for Deep Compressive SamplingXinran Qin, Yuhui Quan, Tongyao Pang, Hui JiCVPR 2023
它引用的顶会 Paper9
- Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep LearningZeyuan Allen-Zhu, Yuanzhi LiICLR 2023 · 被引用 151 次
- Memory-Augmented Deep Unfolding Network for Compressive SensingJiechong Song, Bin Chen, Jian ZhangACM MM 2021 · 被引用 117 次
- Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging ProblemsKaixuan Wei, Angelica I. Avilés-Rivero, Jingwei Liang, Ying Fu 等ICML 2020 · 被引用 114 次
- Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational ImagingHe Sun, Katherine L. BoumanAAAI 2021 · 被引用 82 次
- Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative PriorsZhaoqiang Liu, Subhroshekhar Ghosh, Jonathan ScarlettNeurIPS 2021 · 被引用 22 次
相关 Paper
- Physics-Based Iterative Projection Complex Neural Network for Phase Retrieval in Lensless Microscopy ImagingFeilong Zhang, Xianming Liu, Cheng Guo, Shiyi Lin 等CVPR 2021
- Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurementsDongdong Chen, Julián Tachella, Mike E. DaviesCVPR 2022 · 被引用 51 次
- Self-supervised Deep Image Restoration via Adaptive Stochastic Gradient Langevin DynamicsWeixi Wang, Ji Li, Hui JiCVPR 2022 · 被引用 18 次
- End-to-end reconstruction meets data-driven regularization for inverse problemsSubhadip Mukherjee, Marcello Carioni, Ozan Öktem, Carola-Bibiane SchönliebNeurIPS 2021 · 被引用 54 次
- When deep denoising meets iterative phase retrievalYaotian Wang, Xiaohang Sun, Jason W. FleischerICML 2020 · 被引用 22 次
