Joint Demosaicking and Denoising by Fine-Tuning of Bursts of Raw Images
Thibaud Ehret, Axel Davy, Pablo Arias, Gabriele Facciolo
Abstract
Demosaicking and denoising are the first steps of any camera image processing pipeline and are key for obtaining high quality RGB images. A promising current research trend aims at solving these two problems jointly using convolutional neural networks. Due to the unavailability of ground truth data these networks cannot be currently trained using real RAW images. Instead, they resort to simulated data. In this paper we present a method to learn demosaicking directly from mosaicked images, without requiring ground truth RGB data. We apply this to learn joint demosaicking and denoising only from RAW images, thus enabling the use of real data. In addition we show that for this application fine-tuning a network to a specific burst improves the quality of restoration for both demosaicking and denoising.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 987a298f-061e-4e04-ada2-0f75d1b89a0bCited by top-tier papers10
- STAR: A Structure-aware Lightweight Transformer for Real-time Image EnhancementZhaoyang Zhang, Yitong Jiang, Jun Jiang, Xiaogang Wang et al.ICCV 2021 · 121 citations
- Lucas-Kanade Reloaded: End-to-End Super-Resolution from Raw Image BurstsBruno Lecouat, Jean Ponce, Julien MairalICCV 2021 · 46 citations
- Super-Resolution Capacitive TouchscreensSven Mayer, Xiangyu Xu, Chris HarrisonCHI 2021 · 19 citations
- SiamTrans: Zero-Shot Multi-Frame Image Restoration with Pre-trained Siamese TransformersLin Liu, Shanxin Yuan, Jianzhuang Liu, Xin Guo et al.AAAI 2022 · 17 citations
- Quad Bayer Joint Demosaicing and Denoising Based on Dual Encoder Network with Joint Residual LearningBolun Zheng, Haoran Li, Quan Chen, Tingyu Wang et al.AAAI 2024 · 17 citations
Related papers
- Joint Demosaicking and Denoising in the Wild: The Case of Training Under Ground Truth UncertaintyJierun Chen, Song Wen, S.-H. Gary ChanAAAI 2021 · 16 citations
- End-to-End Learning for Joint Image Demosaicing, Denoising and Super-ResolutionWenzhu Xing, Karen O. EgiazarianCVPR 2021
- A Differentiable Two-stage Alignment Scheme for Burst Image Reconstruction with Large ShiftShi Guo, Xi Yang, Jianqi Ma, Gaofeng Ren et al.CVPR 2022 · 14 citations
- Joint Demosaicing and Denoising With Self GuidanceLin Liu, Xu Jia, Jianzhuang Liu, Qi TianCVPR 2020
- PatchCraft Self-Supervised Training for Correlated Image DenoisingGregory Vaksman, Michael EladCVPR 2023
