Projects per year
Abstract
Traditional full-reference image quality assessment (FR-IQA) methods predict the perceptual quality of a distorted image with a given pristine-quality image as the reference. However, the near-threshold visual perception suggests that there could be numerous pristine-quality representations that are indistinguishable in a scene, and the so-called pristine image used in FR-IQA for reference is just one of them. With numerous approaches proposed for FR-IQA by evaluating the perceptual similarity, much less work has been dedicated to locating the best reference for the deterministic perceptual similarity measure. This article aims to answer the question that whether enabling the freedom in reference image selection could lead to better performance by designing a new FR-IQA paradigm FLexible REference (FLRE). The FLRE paradigm is developed in the feature space by attempting to obtain the feature-level reference of the distorted image via the selection of its corresponding best explanation within an equal-quality space. To this end, we devise the Perceptually Near-Threshold Estimation (PNTE) and the Pseudo-Reference Search (PRS) strategies. In particular, the PNTE module predicts the equal-quality map of a given pristine-quality feature, forming an equal-quality space. Subsequently, the PRS strategy is employed to locate the reference of the distorted feature within the equal-quality space in an element-wise minimum distance search manner. Due to the lack of the ground-truth reference (i.e., best explanation) of each distorted image, we optimize the pseudo-reference feature learning under three constraints, i.e., the quality regression loss, the disturbance maximization loss, and the content loss. We implement the FLRE as a plug-in module before the deterministic FR-IQA process, and experimental results have demonstrated that combining FLRE with the existing deep feature-based FR-IQA models can significantly improve the quality prediction performance, largely surpassing the state-of-the-art methods.
Original language | English |
---|---|
Pages (from-to) | 3278-3290 |
Number of pages | 13 |
Journal | IEEE Transactions on Multimedia |
Volume | 26 |
Early online date | 30 Aug 2023 |
DOIs | |
Publication status | Published - 2024 |
Bibliographical note
Publisher Copyright:© 1999-2012 IEEE.
Funding
This work was supported in part by Hong Kong Innovation and Technology Commission, InnoHK Project Centre for Intelligent Multi dimensional Data Analysis (CIMDA), in part by the National Natural Science Foundation of China under Grant 62022002, in part by the Hong Kong GRF-RGC General Research Fund under Grants 11209819 (CityU 9042816), 11203820 (CityU 9042598), and 11203220 (CityU 9042957)
Keywords
- Flexible reference
- full-reference
- image quality assessment
- near-threshold visual perception
Fingerprint
Dive into the research topics of 'Towards thousands to one reference : Can we trust the reference image for quality assessment?'. Together they form a unique fingerprint.Projects
- 1 Finished
-
Adaptive Dynamic Range Enhancement Oriented to High Dynamic Display (面向高動態顯示的自適應動態範圍增強)
KWONG, S. T. W. (PI), KUO, C.-C. J. (CoI), WANG, S. (CoI) & ZHANG, X. (CoI)
Research Grants Council (HKSAR)
1/01/21 → 31/12/24
Project: Grant Research