Rich Features for Perceptual Quality Assessment of UGC Videos
Yilin Wang, Junjie Ke, Hossein Talebi, Joong Gon Yim, Neil Birkbeck, Balu Adsumilli, Peyman Milanfar, Feng Yang
Abstract
Video quality assessment for User Generated Content (UGC) is an important topic in both industry and academia. Most existing methods only focus on one aspect of the perceptual quality assessment, such as technical quality or compression artifacts. In this paper, we create a large scale dataset to comprehensively investigate characteristics of generic UGC video quality. Besides the subjective ratings and content labels of the dataset, we also propose a DNNbased framework to thoroughly analyze importance of content, technical quality, and compression level in perceptual quality. Our model is able to provide quality scores as well as human-friendly quality indicators, to bridge the gap between low level video signals to human perceptual quality. Experimental results show that our model achieves state-ofthe-art correlation with Mean Opinion Scores (MOS).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 78bea8da-b759-4c45-96d1-5cac8f20ba4eCited by top-tier papers28
- Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical PerspectivesHaoning Wu, Erli Zhang, Liang Liao, Chaofeng Chen et al.ICCV 2023 · 371 citations
- A Deep Learning based No-reference Quality Assessment Model for UGC VideosWei Sun, Xiongkuo Min, Wei Lu, Guangtao ZhaiACM MM 2022 · 239 citations
- Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted ApproachHaoning Wu, Erli Zhang, Liang Liao, Chaofeng Chen et al.ACM MM 2023 · 51 citations
- ClimateNeRF: Extreme Weather Synthesis in Neural Radiance FieldYuan Li, Zhi-Hao Lin, David A. Forsyth, Jia-Bin Huang et al.ICCV 2023 · 44 citations
- Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality AssessmentLiang Liao, Kangmin Xu, Haoning Wu, Chaofeng Chen et al.ACM MM 2022 · 39 citations
Builds on3
- Assessing Image Quality Issues for Real-World ProblemsTai-Yin Chiu, Yinan Zhao, Danna GurariCVPR 2020
- Perceptual Quality Assessment of Smartphone PhotographyYuming Fang, Hanwei Zhu, Yan Zeng, Kede Ma et al.CVPR 2020
- From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture QualityZhenqiang Ying, Haoran Niu, Praful Gupta, Dhruv Mahajan et al.CVPR 2020
Related papers
- PUGCQ: A Large Scale Dataset for Quality Assessment of Professional User-Generated ContentGuo Li, Baoliang Chen, Lingyu Zhu, Qingwen He et al.ACM MM 2021 · 6 citations
- Blind Natural Video Quality Prediction via Statistical Temporal Features and Deep Spatial FeaturesJari Korhonen, Yicheng Su, Junyong YouACM MM 2020 · 88 citations
- Patch-VQ: 'Patching Up' the Video Quality ProblemZhenqiang Ying, Maniratnam Mandal, Deepti Ghadiyaram, Alan C. BovikCVPR 2021
- Knowledge Guided Semi-supervised Learning for Quality Assessment of User Generated VideosShankhanil Mitra, Rajiv SoundararajanAAAI 2024 · 11 citations
- Capturing Co-existing Distortions in User-Generated Content for No-reference Video Quality AssessmentKun Yuan, Zishang Kong, Chuanchuan Zheng, Ming Sun et al.ACM MM 2023 · 15 citations
