Data augmentation for deep learning based accelerated MRI reconstruction with limited data
Zalan Fabian, Reinhard Heckel, Mahdi Soltanolkotabi
Abstract
Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To achieve state-of-the-art performance, training on large and diverse sets of images is considered critical. However, it is often difficult and/or expensive to collect large amounts of training images. Inspired by the success of Data Augmentation (DA) for classification problems, in this paper, we propose a pipeline for data augmentation for accelerated MRI reconstruction and study its effectiveness at reducing the required training data in a variety of settings. Our DA pipeline, MRAugment, is specifically designed to utilize the invariances present in medical imaging measurements as naive DA strategies that neglect the physics of the problem fail. Through extensive studies on multiple datasets we demonstrate that in the low-data regime DA prevents overfitting and can match or even surpass the state of the art while using significantly fewer training data, whereas in the high-data regime it has diminishing returns. Furthermore, our findings show that DA can improve the robustness of the model against various shifts in the test distribution.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0782e50b-92f9-4a3f-af93-111c4e3b0456Cited by top-tier papers4
- Measuring Robustness in Deep Learning Based Compressive SensingMohammad Zalbagi Darestani, Akshay S. Chaudhari, Reinhard HeckelICML 2021 · 94 citations
- Test-Time Training Can Close the Natural Distribution Shift Performance Gap in Deep Learning Based Compressed SensingMohammad Zalbagi Darestani, Jiayu Liu, Reinhard HeckelICML 2022 · 52 citations
- Analyzing the Sample Complexity of Self-Supervised Image Reconstruction MethodsTobit Klug, Dogukan Atik, Reinhard HeckelNeurIPS 2023 · 13 citations
- HiNCoT: Hierarchical Nonlinear Continuous Transform-based Tensor Representation for Multi-Dimensional Data RecoveryTao Yang, Weihao Wu, Tingzhu HuangAAAI 2026
Builds on3
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- Differentiable Augmentation for Data-Efficient GAN TrainingShengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu et al.NeurIPS 2020 · 707 citations
- Measuring Robustness in Deep Learning Based Compressive SensingMohammad Zalbagi Darestani, Akshay S. Chaudhari, Reinhard HeckelICML 2021 · 94 citations
Related papers
- Robustness of Deep Learning for Accelerated MRI: Benefits of Diverse Training DataKang Lin, Reinhard HeckelICML 2024 · 12 citations
- Scaling Laws For Deep Learning Based Image ReconstructionTobit Klug, Reinhard HeckelICLR 2023 · 22 citations
- Modeling the Probabilistic Distribution of Unlabeled Data for One-shot Medical Image SegmentationYuhang Ding, Xin Yu, Yi YangAAAI 2021 · 42 citations
- Recorrupted-to-Recorrupted: Unsupervised Deep Learning for Image DenoisingTongyao Pang, Huan Zheng, Yuhui Quan, Hui JiCVPR 2021
- MotionTTT: 2D Test-Time-Training Motion Estimation for 3D Motion Corrected MRITobit Klug, Kun Wang, Stefan Ruschke, Reinhard HeckelNeurIPS 2024 · 4 citations
