Edit-aware RAW reconstruction
Abhijith Punnappurath, Luxi Zhao, Ke Zhao, Hue Nguyen, Radek Grzeszczuk, Michael S. Brown
摘要
Users frequently edit camera images post-capture to achieve their preferred photofinishing style. While editing in the RAW domain provides greater accuracy and flexibility, most edits are performed on the camera’s display-referred output (e.g., 8-bit sRGB JPEG) since RAW images are rarely stored. Existing RAW reconstruction methods can recover RAW data from sRGB images, but these approaches are typically optimized for pixel-wise RAW reconstruction fidelity and tend to degrade under diverse rendering styles and editing operations. We introduce a plug-and-play, edit-aware loss function that can be integrated into any existing RAW reconstruction framework to make the recovered RAWs more robust to different rendering styles and edits. Our loss formulation incorporates a modular, differentiable image signal processor (ISP) that simulates realistic photofinishing pipelines with tunable parameters. During training, parameters for each ISP module are randomly sampled from carefully designed distributions that model practical variations in real camera processing. The loss is then computed in sRGB space between ground-truth and reconstructed RAWs rendered through this differentiable ISP. Incorporating our loss improves sRGB reconstruction quality by up to 1.5–2 dB PSNR across various editing conditions. Moreover, when applied to metadata-assisted RAW reconstruction methods, our approach enables fine-tuning for target edits, yielding further gains. Since photographic editing is the primary motivation for RAW reconstruction in consumer imaging, our simple yet effective loss function provides a general mechanism for enhancing edit fidelity and rendering flexibility across existing methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- NILUT: Conditional Neural Implicit 3D Lookup Tables for Image EnhancementMarcos V. Conde, Javier Vazquez-Corral, Michael S. Brown, Radu TimofteAAAI 2024 · 被引用 35 次
- Learning sRGB-to-Raw-RGB De-rendering with Content-Aware MetadataSeonghyeon Nam, Abhijith Punnappurath, Marcus A. Brubaker, Michael S. BrownCVPR 2022 · 被引用 16 次
- Time-Aware Auto White Balance in Mobile PhotographyMahmoud Afifi, Luxi Zhao, Abhijith Punnappurath, Mohammed A. Abdelsalam 等ICCV 2025 · 被引用 12 次
- CycleISP: Real Image Restoration via Improved Data SynthesisSyed Waqas Zamir, Aditya Arora, Salman H. Khan, Munawar Hayat 等CVPR 2020
- Metadata-Based RAW Reconstruction via Implicit Neural FunctionsLeyi Li, Huijie Qiao, Qi Ye, Qinmin YangCVPR 2023
相关 Paper
- Invertible Image Signal ProcessingYazhou Xing, Zian Qian, Qifeng ChenCVPR 2021
- ISPDiffuser: Learning RAW-to-sRGB Mappings with Texture-Aware Diffusion Models and Histogram-Guided Color ConsistencyYang Ren, Hai Jiang, Menglong Yang, Wei Li 等AAAI 2025 · 被引用 7 次
- Enhancing RAW-to-sRGB with Decoupled Style Structure in Fourier DomainXuanhua He, Tao Hu, Guoli Wang, Zejin Wang 等AAAI 2024 · 被引用 18 次
- Modeling sRGB Camera Noise with Normalizing FlowsShayan Kousha, Ali Maleky, Michael S. Brown, Marcus A. BrubakerCVPR 2022 · 被引用 21 次
- Model-Based Image Signal Processors via Learnable DictionariesMarcos V. Conde, Steven McDonagh, Matteo Maggioni, Ales Leonardis 等AAAI 2022 · 被引用 62 次
