Multitasks-based Deep Evidential Fusion Network for Blind Image Quality Assessment
Yiwei Lou, Yuanpeng He, Rongchao Zhang, Yongzhi Cao, Hanpin Wang, Yu Huang
Abstract
Blind image quality assessment (BIQA) methods often incorporate auxiliary tasks to improve performance. However, existing approaches face limitations due to insufficient integration and a lack of flexible uncertainty estimation, leading to suboptimal performance. To address these challenges, we propose a multitasks-based Deep Evidential Fusion Network (DEFNet) for BIQA, which performs multitask optimization with the assistance of scene and distortion type classification tasks. To achieve a more robust and reliable representation, we design a novel trustworthy information fusion strategy. It first combines diverse features and patterns across sub-regions to enhance information richness, and then performs local-global information fusion by balancing fine-grained details with coarse-grained context. Moreover, DEFNet exploits advanced uncertainty estimation technique inspired by evidential learning with the help of normal-inverse gamma distribution mixture. Extensive experiments on both synthetic and authentic distortion datasets demonstrate the effectiveness and robustness of the proposed framework. Additional evaluation and analysis are carried out to highlight its strong generalization capability and adaptability to previously unseen scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 20504b94-0be5-43cf-9f87-85b7ea88fbf2Builds on11
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- MUSIQ: Multi-scale Image Quality TransformerJunjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar et al.ICCV 2021 · 1,325 citations
- Deep Evidential RegressionAlexander Amini, Wilko Schwarting, Ava Soleimany, Daniela RusNeurIPS 2020 · 777 citations
- Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma DistributionsHuan Ma, Zongbo Han, Changqing Zhang, Huazhu Fu et al.NeurIPS 2021 · 78 citations
- No-Reference Image Quality Assessment Using Dynamic Complex-Valued Neural ModelZihan Zhou, Yong Xu, Ruotao Xu, Yuhui QuanACM MM 2022 · 7 citations
Related papers
- Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning PerspectiveWeixia Zhang, Guangtao Zhai, Ying Wei, Xiaokang Yang et al.CVPR 2023
- Remember and Reuse: Cross-Task Blind Image Quality Assessment via Relevance-aware Incremental LearningRui Ma, Hanxiao Luo, Qingbo Wu, King Ngi Ngan et al.ACM MM 2021 · 19 citations
- Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper NetworkShaolin Su, Qingsen Yan, Yu Zhu, Cheng Zhang et al.CVPR 2020
- Bridging the Synthetic-to-Authentic Gap: Distortion-Guided Unsupervised Domain Adaptation for Blind Image Quality AssessmentAobo Li, Jinjian Wu, Yongxu Liu, Leida LiCVPR 2024
- Data-Efficient Image Quality Assessment with Attention-Panel DecoderGuanyi Qin, Runze Hu, Yutao Liu, Xiawu Zheng et al.AAAI 2023 · 113 citations
