Lightweight and Fast Real-Time Image Enhancement via Decomposition of the Spatial-Aware Lookup Tables
Wontae Kim, Keuntek Lee, Nam Ik Cho
Abstract
The image enhancement methods based on 3D lookup tables (3D LUTs) efficiently reduce both model size and runtime by interpolating pre-calculated values at the vertices. However, the 3D LUT methods have a limitation due to their lack of spatial information, as they convert color values on a point-by-point basis. Although spatial-aware 3D LUT methods address this limitation, they introduce additional modules that require a substantial number of parameters, leading to increased runtime as image resolution increases. To address this issue, we propose a method for generating image-adaptive LUTs by focusing on the redundant parts of the tables. Our efficient framework decomposes a 3D LUT into a linear sum of low-dimensional LUTs and employs singular value decomposition (SVD). Furthermore, we enhance the modules for spatial feature fusion to be more cache-efficient. Extensive experimental results demonstrate that our model effectively decreases both the number of parameters and runtime while maintaining spatial awareness and performance. The code is available at https://github.com/WontaeaeKim/SVDLUT.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a8408513-dc95-4a06-9723-7bf45dd1f83aCited by top-tier papers1
Ask how each one uses itBuilds on16
- Real-time Image Enhancer via Learnable Spatial-aware 3D Lookup TablesTao Wang, Yong Li, Jingyang Peng, Yipeng Ma et al.ICCV 2021 · 109 citations
- HDR-NeRF: High Dynamic Range Neural Radiance FieldsXin Huang, Qi Zhang, Ying Feng, Hongdong Li et al.CVPR 2022 · 105 citations
- JSI-GAN: GAN-Based Joint Super-Resolution and Inverse Tone-Mapping with Pixel-Wise Task-Specific Filters for UHD HDR VideoSoo Ye Kim, Jihyong Oh, Munchurl KimAAAI 2020 · 93 citations
- A New Journey from SDRTV to HDRTVXiangyu Chen, Zhengwen Zhang, Jimmy S. Ren, Lynhoo Tian et al.ICCV 2021 · 74 citations
- AdaInt: Learning Adaptive Intervals for 3D Lookup Tables on Real-time Image EnhancementCanqian Yang, Meiguang Jin, Xu Jia, Yi Xu et al.CVPR 2022 · 57 citations
Related papers
- SIRLUT: Simulated Infrared Fusion Guided Image-adaptive 3D Lookup Tables for Lightweight Image EnhancementKaijiang Li, Hao Li, Haining Li, Peisen Wang et al.ACM MM 2024 · 2 citations
- CLUT-Net: Learning Adaptively Compressed Representations of 3DLUTs for Lightweight Image EnhancementFengyi Zhang, Hui Zeng, Tianjun Zhang, Lin ZhangACM MM 2022 · 26 citations
- Real-Time Exposure Correction via Collaborative Transformations and Adaptive SamplingZiwen Li, Feng Zhang, Meng Cao, Jinpu Zhang et al.CVPR 2024
- NILUT: Conditional Neural Implicit 3D Lookup Tables for Image EnhancementMarcos V. Conde, Javier Vazquez-Corral, Michael S. Brown, Radu TimofteAAAI 2024 · 35 citations
- Look-Up Table Compression for Efficient Image RestorationYinglong Li, Jiacheng Li, Zhiwei XiongCVPR 2024
