Gain-MLP: Improving HDR Gain Map Encoding via a Lightweight MLP
Trevor D. Canham, SaiKiran Kumar Tedla, Michael J. Murdoch, Michael S. Brown
Abstract
While most images shared on the web and social media platforms are encoded in standard dynamic range (SDR), many displays now can accommodate high dynamic range (HDR) content. Additionally, modern cameras can capture images in an HDR format but convert them to SDR to ensure maximum compatibility with existing workflows and legacy displays. To support both SDR and HDR, new encoding formats are emerging that store additional metadata in SDR images in the form of a gain map. When applied to the SDR image, the gain map recovers the HDR version of the image as needed. These gain maps, however, are typically down-sampled and encoded using standard image compression, such as JPEG and HEIC, which can result in unwanted artifacts. In this paper, we propose to use a lightweight multi-layer perceptron (MLP) network to encode the gain map. The MLP is optimized using the SDR image information as input and provides superior performance in terms of HDR reconstruction. Moreover, the MLP-based approach uses a fixed memory footprint (10 KB) and requires no additional adjustments to accommodate different image sizes or encoding parameters. We conduct extensive experiments on various MLP based HDR embedding strategies and demonstrate that our approach outperforms the current state-of-the-art. Readers can access the code at https://gain-mlp.github.io/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on10
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Real-time neural radiance caching for path tracingThomas Müller, Fabrice Rousselle, Jan Novák, Alexander KellerSIGGRAPH 2021 · 140 citations
- Deep SR-ITM: Joint Learning of Super-Resolution and Inverse Tone-Mapping for 4K UHD HDR ApplicationsSoo Ye Kim, Jihyong Oh, Munchurl KimICCV 2019 · 114 citations
- Bacon: Band-limited Coordinate Networks for Multiscale Scene RepresentationDavid B. Lindell, Dave Van Veen, Jeong Joon Park, Gordon WetzsteinCVPR 2022 · 105 citations
- JSI-GAN: GAN-Based Joint Super-Resolution and Inverse Tone-Mapping with Pixel-Wise Task-Specific Filters for UHD HDR VideoSoo Ye Kim, Jihyong Oh, Munchurl KimAAAI 2020 · 93 citations
Related papers
- MLP Embedded Inverse Tone MappingPanjun Liu, Jiacheng Li, Lizhi Wang, Zheng-Jun Zha et al.ACM MM 2024 · 3 citations
- GamutMLP: A Lightweight MLP for Color Loss RecoveryHoang M. Le, Brian L. Price, Scott Cohen, Michael S. BrownCVPR 2023
- Learning Gain Map for Inverse Tone MappingYinuo Liao, Yuanshen Guan, Ruikang Xu, Jiacheng Li et al.ICLR 2025
- HDR Image Generation via Gain Map Decomposed DiffusionYuanshen Guan, Ruikang Xu, Yinuo Liao, Mingde Yao et al.ICCV 2025 · 1 citation
- RawHDR: High Dynamic Range Image Reconstruction from a Single Raw ImageYunhao Zou, Chenggang Yan, Ying FuICCV 2023 · 36 citations
