Learning Pixel-Adaptive Multi-Layer Perceptrons for Real-Time Image Enhancement
Junyu Lou, Xiaorui Zhao, Kexuan Shi, Shuhang Gu
Abstract
Deep learning-based bilateral grid processing has emerged as a promising solution for image enhancement, inherently encoding spatial and intensity information while enabling efficient full-resolution processing through slicing operations. However, existing approaches are limited to linear affine transformations, hindering their ability to model complex color relationships. Meanwhile, while multi-layer perceptrons (MLPs) excel at non-linear mappings, traditional MLP-based methods employ globally shared parameters, which is hard to deal with localized variations. To overcome these dual challenges, we propose a Bilateral Grid-based Pixel-Adaptive Multi-layer Perceptron (BPAM) framework. Our approach synergizes the spatial modeling of bilateral grids with the non-linear capabilities of MLPs. Specifically, we generate bilateral grids containing MLP parameters, where each pixel dynamically retrieves its unique transformation parameters and obtain a distinct MLP for color mapping based on spatial coordinates and intensity values. In addition, we propose a novel grid decomposition strategy that categorizes MLP parameters into distinct types stored in separate subgrids. Multi-channel guidance maps are used to extract category-specific parameters from corresponding subgrids, ensuring effective utilization of color information during slicing while guiding precise parameter generation. Extensive experiments on public datasets demonstrate that our method outperforms state-of-the-art methods in performance while maintaining real-time processing capabilities.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2abc7710-554b-44cf-b80f-81d374e57076Cited by top-tier papers2
- CAST-LUT: Tokenizer-Guided HSV Look-Up Tables for Purple Flare RemovalPu Wang, Shuning Sun, Jialang Lu, Chen Wu et al.AAAI 2026 · 2 citations
- DCA-LUT: Deep Chromatic Alignment with 5D LUT for Purple Fringing RemovalJialang Lu, Shuning Sun, Pu Wang, Chen Wu et al.AAAI 2026
Builds on19
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer et al.NeurIPS 2021 · 3,862 citations
- Pay Attention to MLPsHanxiao Liu, Zihang Dai, David R. So, Quoc V. LeNeurIPS 2021 · 912 citations
- URetinex-Net: Retinex-based Deep Unfolding Network for Low-light Image EnhancementWenhui Wu, Jian Weng, Pingping Zhang, Xu Wang et al.CVPR 2022 · 695 citations
- MAXIM: Multi-Axis MLP for Image ProcessingZhengzhong Tu, Hossein Talebi, Han Zhang, Feng Yang et al.CVPR 2022 · 550 citations
- Iterative Prompt Learning for Unsupervised Backlit Image EnhancementZhexin Liang, Chongyi Li, Shangchen Zhou, Ruicheng Feng et al.ICCV 2023 · 196 citations
Related papers
- AdaCM: Adaptive ColorMLP for Real-Time Universal Photo-Realistic Style TransferTianwei Lin, Honglin Lin, Fu Li, Dongliang He et al.AAAI 2023 · 8 citations
- Deep Spatial Adaptive Network for Real Image DemosaicingTao Zhang, Ying Fu, Cheng LiAAAI 2022 · 23 citations
- Ultra-High-Definition Image Dehazing via Multi-Guided Bilateral LearningZhuoran Zheng, Wenqi Ren, Xiaochun Cao, Xiaobin Hu et al.CVPR 2021
- Ultra-High-Definition Image HDR Reconstruction via Collaborative Bilateral LearningZhuoran Zheng, Wenqi Ren, Xiaochun Cao, Tao Wang et al.ICCV 2021 · 40 citations
- Fast, High-Quality Hierarchical Depth-Map Super-ResolutionYiguo Qiao, Licheng Jiao, Wenbin Li, Christian Richardt et al.ACM MM 2021 · 7 citations
