A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer

Shujun LANG, Xu LIU, Mingliang ZHOU, Jun LUO*, Huayan PU, Xu ZHUANG, Jason WANG, Xuekai WEI, Taiping ZHANG, Yong FENG, Zhaowei SHANG

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

2 Citations (Scopus)

Abstract

In this paper, a full-reference image quality assessment (FR-IQA) model based on deep meta-learning and Conformer is proposed. We combine the Conformer architecture with a Siamese network to extract the feature vectors of the reference and distorted images and calculate the similarity of these feature vectors as the predicted score of the image. We use meta-learning to help the model identify different types of image distortion. First, because the information taken as input by the human visual system (HVS) ranges in scale from local to global, we use a Conformer network as a feature extractor to obtain the global and local features of the pristine and distorted images and use a Siamese network to reduce the number of parameters in our model. Second, we use meta-learning to carry out bilevel gradient descent from the query set to the support set in the training stage and fine-tune the model parameters on a few images with unknown distortion types in the testing stage to improve the generalization ability of the model. Experiments show that our method is competitive with existing FR-IQA methods on three standard IQA datasets.

Original languageEnglish
Pages (from-to)316-324
Number of pages9
JournalIEEE Transactions on Broadcasting
Volume70
Issue number1
DOIs
Publication statusPublished - Mar 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 1963-12012 IEEE.

Keywords

  • conformer
  • Full-reference image quality assessment
  • knowledge-driven
  • meta-learning

Fingerprint

Dive into the research topics of 'A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer'. Together they form a unique fingerprint.

Cite this