VCRNet : Visual Compensation Restoration Network for No-Reference Image Quality Assessment

Zhaoqing PAN, Feng YUAN, Jianjun LEI, Yuming FANG, Xiao SHAO, Sam KWONG

Research output: Journal PublicationsJournal Article (refereed)peer-review

49 Citations (Scopus)

Abstract

Guided by the free-energy principle, generative adversarial networks (GAN)-based no-reference image quality assessment (NR-IQA) methods have improved the image quality prediction accuracy. However, the GAN cannot well handle the restoration task for the free-energy principle-guided NR-IQA methods, especially for the severely destroyed images, which results in that the quality reconstruction relationship between the distorted image and its restored image cannot be accurately built. To address this problem, a visual compensation restoration network (VCRNet)-based NR-IQA method is proposed, which uses a non-adversarial model to efficiently handle the distorted image restoration task. The proposed VCRNet consists of a visual restoration network and a quality estimation network. To accurately build the quality reconstruction relationship between the distorted image and its restored image, a visual compensation module, an optimized asymmetric residual block, and an error map-based mixed loss function, are proposed for increasing the restoration capability of the visual restoration network. For further addressing the NR-IQA problem of severely destroyed images, the multi-level restoration features which are obtained from the visual restoration network are used for the image quality estimation. To prove the effectiveness of the proposed VCRNet, seven representative IQA databases are used, and experimental results show that the proposed VCRNet achieves the state-of-the-art image quality prediction accuracy. The implementation of the proposed VCRNet has been released at https://github.com/NUIST-Videocoding/VCRNet.
Original languageEnglish
Pages (from-to)1613-1627
JournalIEEE Transactions on Image Processing
Volume31
Early online date26 Jan 2022
DOIs
Publication statusPublished - 2022
Externally publishedYes

Keywords

  • error map loss
  • multi-level features
  • No-reference image quality assessment
  • optimized asymmetric residual block
  • visual compensation module
  • visual compensation restoration network

Fingerprint

Dive into the research topics of 'VCRNet : Visual Compensation Restoration Network for No-Reference Image Quality Assessment'. Together they form a unique fingerprint.

Cite this