Edit-aware RAW reconstruction
Abhijith Punnappurath, Luxi Zhao, Ke Zhao, Hue Nguyen, Radek Grzeszczuk, Michael S. Brown
Abstract
Users frequently edit camera images post-capture to achieve their preferred photofinishing style. While editing in the RAW domain provides greater accuracy and flexibility, most edits are performed on the camera’s display-referred output (e.g., 8-bit sRGB JPEG) since RAW images are rarely stored. Existing RAW reconstruction methods can recover RAW data from sRGB images, but these approaches are typically optimized for pixel-wise RAW reconstruction fidelity and tend to degrade under diverse rendering styles and editing operations. We introduce a plug-and-play, edit-aware loss function that can be integrated into any existing RAW reconstruction framework to make the recovered RAWs more robust to different rendering styles and edits. Our loss formulation incorporates a modular, differentiable image signal processor (ISP) that simulates realistic photofinishing pipelines with tunable parameters. During training, parameters for each ISP module are randomly sampled from carefully designed distributions that model practical variations in real camera processing. The loss is then computed in sRGB space between ground-truth and reconstructed RAWs rendered through this differentiable ISP. Incorporating our loss improves sRGB reconstruction quality by up to 1.5–2 dB PSNR across various editing conditions. Moreover, when applied to metadata-assisted RAW reconstruction methods, our approach enables fine-tuning for target edits, yielding further gains. Since photographic editing is the primary motivation for RAW reconstruction in consumer imaging, our simple yet effective loss function provides a general mechanism for enhancing edit fidelity and rendering flexibility across existing methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- NILUT: Conditional Neural Implicit 3D Lookup Tables for Image EnhancementMarcos V. Conde, Javier Vazquez-Corral, Michael S. Brown, Radu TimofteAAAI 2024 · 35 citations
- Learning sRGB-to-Raw-RGB De-rendering with Content-Aware MetadataSeonghyeon Nam, Abhijith Punnappurath, Marcus A. Brubaker, Michael S. BrownCVPR 2022 · 16 citations
- Time-Aware Auto White Balance in Mobile PhotographyMahmoud Afifi, Luxi Zhao, Abhijith Punnappurath, Mohammed A. Abdelsalam et al.ICCV 2025 · 12 citations
- CycleISP: Real Image Restoration via Improved Data SynthesisSyed Waqas Zamir, Aditya Arora, Salman H. Khan, Munawar Hayat et al.CVPR 2020
- Metadata-Based RAW Reconstruction via Implicit Neural FunctionsLeyi Li, Huijie Qiao, Qi Ye, Qinmin YangCVPR 2023
Related papers
- Invertible Image Signal ProcessingYazhou Xing, Zian Qian, Qifeng ChenCVPR 2021
- ISPDiffuser: Learning RAW-to-sRGB Mappings with Texture-Aware Diffusion Models and Histogram-Guided Color ConsistencyYang Ren, Hai Jiang, Menglong Yang, Wei Li et al.AAAI 2025 · 7 citations
- Enhancing RAW-to-sRGB with Decoupled Style Structure in Fourier DomainXuanhua He, Tao Hu, Guoli Wang, Zejin Wang et al.AAAI 2024 · 18 citations
- Modeling sRGB Camera Noise with Normalizing FlowsShayan Kousha, Ali Maleky, Michael S. Brown, Marcus A. BrubakerCVPR 2022 · 21 citations
- Model-Based Image Signal Processors via Learnable DictionariesMarcos V. Conde, Steven McDonagh, Matteo Maggioni, Ales Leonardis et al.AAAI 2022 · 62 citations
