Attentive Illumination Decomposition Model for Multi-Illuminant White Balancing
Dongyoung Kim, Jinwoo Kim, Junsang Yu, Seon Joo Kim
Abstract
White balance (WB) algorithms in many commercial cameras assume single and uniform illumination, leading to undesirable results when multiple lighting sources with different chromaticities exist in the scene. Prior research on multi-illuminant WB typically predicts illumination at the pixel level without fully grasping the scene's actual lighting conditions, including the number and color of light sources. This often results in unnatural outcomes lacking in overall consistency. To handle this problem, we present a deep white balancing model that leverages the slot attention, where each slot is in charge of representing individual illuminants. This design enables the model to generate chromaticities and weight maps for individual illuminants, which are then fused to compose the final illumination map. Furthermore, we propose the centroid-matching loss, which regulates the activation of each slot based on the color range, thereby enhancing the model to separate illumination more effectively. Our method achieves the state-of-theart performance on both single-and multi-illuminant WB benchmarks, and also offers additional information such as the number of illuminants in the scene and their chromaticity. This capability allows for illumination editing, an application not feasible with prior methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color ConstancyDongyoung Kim, Mahmoud Afifi, Dongyun Kim, Michael S. Brown et al.ICCV 2025 · 5 citations
- Revisiting Image Fusion for Multi-Illuminant White-Balance CorrectionDavid Serrano-Lozano, Aditya Arora, Luis Herranz, Konstantinos G. Derpanis et al.ICCV 2025 · 1 citation
- Illumination Spectrum Estimation for Multispectral Images via Surface Reflectance Modeling and Spatial-Spectral Feature GenerationHyejin Oh, Woo-Shik Kim, Sangyoon Lee, YungKyung Park et al.CVPR 2025
- Integral Fast Fourier Color ConstancyWenjun Wei, Yanlin Qian, Huaian Chen, Junkang Dai et al.CVPR 2025
- Exposure-slot: Exposure-centric Representations Learning with Slot-in-Slot Attention for Region-aware Exposure CorrectionDonggoo Jung, Daehyun Kim, Guanghui Wang, Tae Hyun KimCVPR 2025
Builds on11
- Object-Centric Learning with Slot AttentionFrancesco Locatello, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran et al.NeurIPS 2020 · 1,275 citations
- GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent RepresentationsMartin Engelcke, Adam R. Kosiorek, Oiwi Parker Jones, Ingmar PosnerICLR 2020 · 334 citations
- Conditional Object-Centric Learning from VideoThomas Kipf, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Austin Stone et al.ICLR 2022 · 290 citations
- Object Scene Representation TransformerMehdi S. M. Sajjadi, Daniel Duckworth, Aravindh Mahendran, Sjoerd van Steenkiste et al.NeurIPS 2022 · 124 citations
- A Dataset of Multi-Illumination Images in the WildLukas Murmann, Michaël Gharbi, Miika Aittala, Frédo DurandICCV 2019 · 84 citations
Related papers
- Large Scale Multi-Illuminant (LSMI) Dataset for Developing White Balance Algorithm under Mixed IlluminationDongyoung Kim, Jinwoo Kim, Seonghyeon Nam, Dongwoo Lee et al.ICCV 2021 · 35 citations
- SWBNet: A Stable White Balance Network for sRGB ImagesChunxiao Li, Xuejing Kang, Zhifeng Zhang, Anlong MingAAAI 2023 · 8 citations
- Physically-plausible illumination distribution estimationEgor I. Ershov, Vasily Tesalin, Ivan Ermakov, Michael S. BrownICCV 2023 · 9 citations
- HVDualformer: Histogram-Vision Dual Transformer for White BalanceYan-Tsung Peng, Guan-Rong ChenAAAI 2025 · 1 citation
- ABC-Former: Auxiliary Bimodal Cross-domain Transformer with Interactive Channel Attention for White BalanceYu-Cheng Chiu, Guan-Rong Chen, Zihao Chen, Yan-Tsung PengCVPR 2025
