Troubleshooting Blind Image Quality Models in the Wild

05/14/2021
by   Zhihua Wang, et al.
0

Recently, the group maximum differentiation competition (gMAD) has been used to improve blind image quality assessment (BIQA) models, with the help of full-reference metrics. When applying this type of approach to troubleshoot "best-performing" BIQA models in the wild, we are faced with a practical challenge: it is highly nontrivial to obtain stronger competing models for efficient failure-spotting. Inspired by recent findings that difficult samples of deep models may be exposed through network pruning, we construct a set of "self-competitors," as random ensembles of pruned versions of the target model to be improved. Diverse failures can then be efficiently identified via self-gMAD competition. Next, we fine-tune both the target and its pruned variants on the human-rated gMAD set. This allows all models to learn from their respective failures, preparing themselves for the next round of self-gMAD competition. Experimental results demonstrate that our method efficiently troubleshoots BIQA models in the wild with improved generalizability.

READ FULL TEXT

page 1

page 4

page 7

page 8

research
03/08/2020

Active Fine-Tuning from gMAD Examples Improves Blind Image Quality Assessment

The research in image quality assessment (IQA) has a long history, and s...
research
05/28/2020

Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild

Performance of blind image quality assessment (BIQA) models has been sig...
research
07/05/2019

Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network

We propose a deep bilinear model for blind image quality assessment (BIQ...
research
07/01/2019

Learning to Blindly Assess Image Quality in the Laboratory and Wild

Previous models for blind image quality assessment (BIQA) can only be tr...
research
03/27/2023

Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective

We aim at advancing blind image quality assessment (BIQA), which predict...
research
06/26/2021

Semi-Supervised Deep Ensembles for Blind Image Quality Assessment

Ensemble methods are generally regarded to be better than a single model...
research
07/17/2023

The FathomNet2023 Competition Dataset

Ocean scientists have been collecting visual data to study marine organi...

Please sign up or login with your details

Forgot password? Click here to reset