CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color Constancy
Dongyoung Kim, Mahmoud Afifi, Dongyun Kim, Michael S. Brown, Seon Joo Kim
Abstract
Computational color constancy, or white balancing, is a key module in a camera's image signal processor (ISP) that corrects color casts from scene lighting. Because this operation occurs in the camera-specific raw color space, white balance algorithms must adapt to different cameras. This paper introduces a learning-based method for cross-camera color constancy that generalizes to new cameras without retraining. Our method leverages pre-calibrated color correction matrices (CCMs) available on ISPs that map the camera's raw color space to a standard space (e.g., CIE XYZ). Our method uses these CCMs to transform predefined illumination colors (i.e., along the Planckian locus) into the test camera's raw space. The mapped illuminants are encoded into a compact camera fingerprint embedding (CFE) that enables the network to adapt to unseen cameras. To prevent overfitting due to limited cameras and CCMs during training, we introduce a data augmentation technique that interpolates between cameras and their CCMs. Experimental results across multiple datasets and backbones show that our method achieves state-of-the-art cross-camera color constancy while remaining lightweight and relying only on data readily available in camera ISPs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Cascading Convolutional Color ConstancyHuanglin Yu, Ke Chen, Kaiqi Wang, Yanlin Qian et al.AAAI 2020 · 76 citations
- Cross-Camera Convolutional Color ConstancyMahmoud Afifi, Jonathan T. Barron, Chloe LeGendre, Yun-Ta Tsai et al.ICCV 2021 · 63 citations
- Large Scale Multi-Illuminant (LSMI) Dataset for Developing White Balance Algorithm under Mixed IlluminationDongyoung Kim, Jinwoo Kim, Seonghyeon Nam, Dongwoo Lee et al.ICCV 2021 · 35 citations
- Transfer Learning for Color Constancy via Statistic PerspectiveYuxiang Tang, Xuejing Kang, Chunxiao Li, Zhaowen Lin et al.AAAI 2022 · 24 citations
- NightCC: Nighttime Color Constancy via Adaptive Channel MaskingShuwei Li, Robby T. TanCVPR 2024
Related papers
- Generalizing ISP Model by Unsupervised Raw-to-raw MappingDongyu Xie, Chaofan Qiao, Lanyue Liang, Zhiwen Wang et al.ACM MM 2024 · 5 citations
- Multi-Domain Learning for Accurate and Few-Shot Color ConstancyJin Xiao, Shuhang Gu, Lei ZhangCVPR 2020
- A Multi-Hypothesis Approach to Color ConstancyDaniel Hernández Juárez, Sarah Parisot, Benjamin Busam, Ales Leonardis et al.CVPR 2020
- Model-Based Image Signal Processors via Learnable DictionariesMarcos V. Conde, Steven McDonagh, Matteo Maggioni, Ales Leonardis et al.AAAI 2022 · 62 citations
- Deep White-Balance EditingMahmoud Afifi, Michael S. BrownCVPR 2020
