Equivariant Imaging: Learning Beyond the Range Space
Dongdong Chen, Julián Tachella, Mike E. Davies
Abstract
In various imaging problems, we only have access to compressed measurements of the underlying signals, hindering most learning-based strategies which usually require pairs of signals and associated measurements for training Learning only from compressed measurements is impossible in general, as the compressed observations do not contain information outside the range of the forward sensing operator. We propose a new end-to-end self-supervised framework that overcomes this limitation by exploiting the equivariances present in natural signals. Our proposed learning strategy performs as well as fully supervised methods. Experiments demonstrate the potential of this frame- work on inverse problems including sparse-view X-ray computed tomography on real clinical data and image inpainting on natural images. Code has been made available at: https://github.com/edongdongchen/EI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers22
- Equivariant Multi-Modality Image FusionZixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang et al.CVPR 2024 · 155 citations
- Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurementsDongdong Chen, Julián Tachella, Mike E. DaviesCVPR 2022 · 51 citations
- Unsupervised Learning From Incomplete Measurements for Inverse ProblemsJulián Tachella, Dongdong Chen, Mike E. DaviesNeurIPS 2022 · 38 citations
- What's in a Prior? Learned Proximal Networks for Inverse ProblemsZhenghan Fang, Sam Buchanan, Jeremias SulamICLR 2024 · 27 citations
- Equivariant Plug-and-Play Image ReconstructionMatthieu Terris, Thomas Moreau, Nelly Pustelnik, Julián TachellaCVPR 2024 · 25 citations
Builds on4
- Free-Form Image Inpainting With Gated ConvolutionJiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen et al.ICCV 2019 · 1,990 citations
- Improving Transformation Invariance in Contrastive Representation LearningAdam Foster, Rattana Pukdee, Tom RainforthICLR 2021 · 25 citations
- Noisier2Noise: Learning to Denoise From Unpaired Noisy DataNick Moran, Dan Schmidt, Yu Zhong, Patrick CoadyCVPR 2020
- The Neural Tangent Link Between CNN Denoisers and Non-Local FiltersJulián Tachella, Junqi Tang, Mike E. DaviesCVPR 2021
Related papers
- Equivariant Splitting: Self-supervised learning from incomplete dataVictor Sechaud, Jérémy Scanvic, Quentin Barthélemy, Patrice Abry et al.ICLR 2026 · 5 citations
- Normalization-equivariant Diffusion Models: Learning Posterior Samplers From Noisy And Partial MeasurementsBrett Levac, Jon Tamir, Marcelo Pereyra, Julián TachellaICML 2026 · 2 citations
- Compressive sensing with un-trained neural networks: Gradient descent finds a smooth approximationReinhard Heckel, Mahdi SoltanolkotabiICML 2020 · 91 citations
- End-to-end reconstruction meets data-driven regularization for inverse problemsSubhadip Mukherjee, Marcello Carioni, Ozan Öktem, Carola-Bibiane SchönliebNeurIPS 2021 · 54 citations
- Solving Inverse Problems in Medical Imaging with Score-Based Generative ModelsYang Song, Liyue Shen, Lei Xing, Stefano ErmonICLR 2022 · 721 citations
