Skip to main navigation Skip to search Skip to main content

No-Reference Image Quality Assessment: Exploring Intrinsic Distortion Characteristics via Generative Noise Estimation with Mamba

  • Xuting LAN
  • , Weizhi XIAN
  • , Mingliang ZHOU
  • , Jielu YAN
  • , Xuekai WEI
  • , Jun LUO
  • , Weijia JIA
  • , Sam KWONG

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

In the field of no-reference image quality assessment (NR-IQA), the visual masking effect has long been a challenging issue. Although existing methods attempt to alleviate the interference caused by masking by generating pseudoreference images, the quality of these images is often constrained by the accuracy and reconstruction capabilities of image restoration algorithms. This can introduce additional biases, thereby affecting the reliability of the evaluation results. To address this problem, we propose a novel generative “noise” estimation framework (GNE-Vim) that eliminates the need for pseudoreference images. Instead, it deeply decouples the distortion components from degraded images and performs quality-aware modelling of these components. During the training phase, the model leverages both reference images and distortion components to guide the learning of the true distortion distribution. In the inference phase, quality prediction is conducted directly on the basis of the decoupled distortion components, making the evaluation results more aligned with human subjective perception. The experimental results demonstrate that the proposed method achieves strong performance across datasets containing various types of distortions. The source code is publicly available at the following website: https://github.com/opencodelxt/GNE-Vim.
Original languageEnglish
Pages (from-to)12692-12706
Number of pages15
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume35
Issue number12
DOIs
Publication statusPublished - 1 Jan 2025

Bibliographical note

Publisher Copyright:
© 1991-2012 IEEE.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 62176027, in part by Chongqing Talent under Grant cstc2024ycjh-bgzxm0082, in part by the Central University Operating Expenses under Grant 2024CDJGF-044, in part by Chongqing New YinCai (YC) Project under Grant CSTB2024YCJH-KYXM0126, in part by the Postdoctoral Fellowship Program of China Postdoctoral Science Foundation (CPSF) under Grant GZC20233322, in part by the General Program of the Natural Science Foundation of Chongqing under Grant CSTB2024NSCQMSX0479, in part by Chongqing Postdoctoral Foundation Special Support Program under Grant 2023CQBSHTB3119, and in part by CPSF under Grant 2024MD754244.

Keywords

  • No-reference image quality assessment
  • fusion network
  • generative noise estimation
  • vision mamba

Fingerprint

Dive into the research topics of 'No-Reference Image Quality Assessment: Exploring Intrinsic Distortion Characteristics via Generative Noise Estimation with Mamba'. Together they form a unique fingerprint.

Cite this