Towards Syn-to-Real IQA: A Novel Perspective on Reshaping Synthetic Data Distributions
Aobo Li, Jinjian Wu, Yongxu Liu, Leida Li, Weisheng Dong
Abstract
Blind Image Quality Assessment (BIQA) has advanced significantly through deep learning, but the scarcity of large-scale labeled datasets remains a challenge. While synthetic data offers a promising solution, models trained on existing synthetic datasets often show limited generalization ability. In this work, we make a key observation that representations learned from synthetic datasets often exhibit a discrete and clustered pattern that hinders regression performance: features of high-quality images cluster around reference images, while those of low-quality images cluster based on distortion types. Our analysis reveals that this issue stems from the distribution of synthetic data rather than model architecture. Consequently, we introduce a novel framework SynDR-IQA, which reshapes synthetic data distribution to enhance BIQA generalization. Based on theoretical derivations of sample diversity and redundancy's impact on generalization error, SynDR-IQA employs two strategies: distribution-aware diverse content upsampling, which enhances visual diversity while preserving content distribution, and density-aware redundant cluster downsampling, which balances samples by reducing the density of densely clustered areas. Extensive experiments across three cross-dataset settings (synthetic-to-authentic, synthetic-to-algorithmic, and synthetic-to-synthetic) demonstrate the effectiveness of our method. The code is available at https://github.com/Li-aobo/SynDR-IQA.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 03ff1a85-2793-4fdb-93fb-986c3ebbffb7Builds on16
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- MUSIQ: Multi-scale Image Quality TransformerJunjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar et al.ICCV 2021 · 1,325 citations
- Exploring CLIP for Assessing the Look and Feel of ImagesJianyi Wang, Kelvin C. K. Chan, Chen Change LoyAAAI 2023 · 1,208 citations
Related papers
- Bridging the Synthetic-to-Authentic Gap: Distortion-Guided Unsupervised Domain Adaptation for Blind Image Quality AssessmentAobo Li, Jinjian Wu, Yongxu Liu, Leida LiCVPR 2024
- Quality-aware Pretrained Models for Blind Image Quality AssessmentKai Zhao, Kun Yuan, Ming Sun, Mading Li et al.CVPR 2023
- Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper NetworkShaolin Su, Qingsen Yan, Yu Zhu, Cheng Zhang et al.CVPR 2020
- Semi-Supervised Blind Image Quality Assessment through Knowledge Distillation and Incremental LearningWensheng Pan, Timin Gao, Yan Zhang, Xiawu Zheng et al.AAAI 2024 · 15 citations
- Towards Distortion-Debiased Blind Image Quality AssessmentLize Zhou, Xiaoqi Wang, Jian Xiong, Xianzhong Long et al.ACM MM 2024 · 1 citation
