Thinking Aesthetics Assessment of Image Color Temperature: Models, Datasets and Benchmarks
Jinguang Cheng, Chunxiao Li, Shuai He, Taiyu Chen, Anlong Ming
Abstract
Color temperature, as a crucial attribute influencing image color, plays a critical role in Image Aesthetics Assessment (IAA). Yet, within the existing IAA field, little light has been shed on assessing the aesthetic quality of image color temperature. To bridge this gap, we introduce a new task: Image Color Temperature Aesthetics Assessment (ICTAA). However, this task poses the following challenges: 1) Perceptual Sensitivity: humans exhibit high sensitivity to subtle shifts in color temperature, necessitating a model to enable fine-grained discrimination; 2) Spectral Continuity: The theoretical modeling of color temperature aesthetics requires continuous labels; however, the just-noticeable-difference property of human perception makes continuous labeling infeasible, necessitating a well-designed labeling strategy. To address the aforementioned challenges, we make the following efforts. First, we propose a multi-modal contrastive learning framework, ICTA2Net, that models color temperature differences between image pairs while strictly controlling other visual attributes. Second, leveraging color temperature transitivity, we design a weakly supervised strategy that discretely samples images based on anchor images and human perception to build contrastive relations across color temperatures, enabling learning from discrete labels. Thirdly, we construct a color temperature aesthetics dataset, ICTAA240K, and a benchmark for validation. Additionally, we propose a new metric, Information Entropy-weighted Accuracy (IEA), which weights accuracy by the degree of annotation disagreement to reflect model performance across varying sample difficulties, complementing existing evaluation metrics. Experiments show our method outperforms existing state-of-the-art IAA methods on ICTAA240K, thereby setting an effective roadmap for ICTAA.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- MUSIQ: Multi-scale Image Quality TransformerJunjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar et al.ICCV 2021 · 1,325 citations
- Vision Transformer with Deformable AttentionZhuofan Xia, Xuran Pan, Shiji Song, Li Erran Li et al.CVPR 2022 · 835 citations
- Hierarchical Layout-Aware Graph Convolutional Network for Unified Aesthetics AssessmentDongyu She, Yu-Kun Lai, Gaoxiong Yi, Kun XuCVPR 2021
- Perceptual Quality Assessment of Smartphone PhotographyYuming Fang, Hanwei Zhu, Yan Zeng, Kede Ma et al.CVPR 2020
Related papers
- AesCLIP: Multi-Attribute Contrastive Learning for Image Aesthetics AssessmentXiangfei Sheng, Leida Li, Pengfei Chen, Jinjian Wu et al.ACM MM 2023 · 36 citations
- Semantics-Aware Image Aesthetics Assessment using Tag Matching and Contrastive RankingZhichao Yang, Leida Li, Pengfei Chen, Jinjian Wu et al.ACM MM 2024 · 6 citations
- Thinking Image Color Aesthetics Assessment: Models, Datasets and BenchmarksShuai He, Anlong Ming, Yaqi Li, Jinyuan Sun et al.ICCV 2023 · 36 citations
- AACP: Aesthetics Assessment of Children's Paintings Based on Self-Supervised LearningShiqi Jiang, Ning Li, Chen Shi, Liping Guo et al.AAAI 2024 · 2 citations
- AesMamba: Universal Image Aesthetic Assessment with State Space ModelsFei Gao, Yuhao Lin, Jiaqi Shi, Maoying Qiao et al.ACM MM 2024 · 12 citations
