Abstract
Recently, applying deep learning to no-reference image quality assessment (NR-IQA) has received significant attention. Especially in the last five years, an increasing interest has been drawn to the studies of rank learning since it can help mitigate the problem of small IQA datasets. However, on one hand, existing rank learning is not suitable for the authentically distorted images due to the lack of generated rank samples. On the other hand, the output of existing rank loss functions is uncontrollable, resulting in reduced performance. Motivated by these two limitations, we propose a novel rank learning based NR-IQA method, termed controllable list-wise ranking IQA (CLRIQA) in this paper. To be specific, we first present an imaging-heuristic approach, in which the over- and under-exposure is formulated as an inverse of the Weber-Fechner law, and fusion strategy and compression are adopted, to simulate the authentic distortion and generate the rank image samples. These samples are label-free yet associated with quality ranking information. Then we design a controllable list-wise ranking (CLR) loss function by setting an upper and lower bound of rank range and introducing an adaptive margin to tune rank interval. Finally, both the generated rank samples and proposed CLR are used to pre-train a convolutional neural network. Moreover, to obtain a more accurate prediction model, we take advantage of the IQA datasets to fine-tune the pre-trained network further. Various experiments are conducted on the IQA benchmark datasets, and experimental results demonstrate the effectiveness of the proposed CLRIQA method. The source code and network model can be downloaded at the following web address: https://github.com/GZHU-Image-Lab/CLRIQA.
Original language | English |
---|---|
Pages (from-to) | 4197-4211 |
Number of pages | 15 |
Journal | IEEE Transactions on Multimedia |
Volume | 24 |
Early online date | 27 Sept 2021 |
DOIs | |
Publication status | Published - 2022 |
Externally published | Yes |
Bibliographical note
Publisher Copyright:© 1999-2012 IEEE.
Funding
This work was supported in part by the National Natural Science Foundation of China under Grants 61872099 and 61872350, in part by Hong Kong GRF-RGC General Research Fund CityU 11209819 and CityU 11203820, in part by the Science and Technology Program of Guangzhou underGrant 201904010478, and in part by the ScientificResearch Project of Guangzhou University under Grant YJ2021004.
Keywords
- authentic distortion
- convolutional neural network
- No-reference image quality assessment
- rank learning
- synthetic distortion