Quaternion representation based visual saliency for stereoscopic image quality assessment

Xu WANG, Lin MA, Sam KWONG, Yu ZHOU

Research output: Journal PublicationsJournal Article (refereed)peer-review

35 Citations (Scopus)

Abstract

In this paper, a novel visual saliency detection method for stereoscopic images is proposed for the stereoscopic image quality assessment (SIQA) by considering the disparity map and difference image between the stereo image pairs. Firstly, a new quaternion representation (QR) of each stereo image (left/right view image) is constructed, which comprises the image content, the inter-view disparity, and the difference map. The quaternion Fourier transform (QFT) is performed on the constructed QR to generate the visual saliency maps for left and right views of stereoscopic image pairs, respectively. The generated visual saliency maps are further incorporated into the quality metrics for SIQA. Experimental results demonstrate that the visual saliency maps generated by the proposed method can help significantly boost the performance of SIQA, comparing with other visual saliency models proposed for stereoscopic images. It further confirms that the proposed visual saliency model can accurate depict the acuity property of human visual system (HVS) in judging the perceptual quality of stereoscopic images.
Original languageEnglish
Pages (from-to)202-213
JournalSignal Processing
Volume145
Early online date8 Dec 2017
DOIs
Publication statusPublished - Apr 2018
Externally publishedYes

Bibliographical note

This work was supported in part by the Natural Science Foundation of China under Grants 61501299, 61672443, 61702336 and 61620106008, in part by the Guangdong Nature Science Foundation under Grant 2016A030310058, in part by Hong Kong RGC General Research Fund (GRF) 9042322 (CityU 11200116) and 9042489 (CityU 11206317), in part by the Shenzhen Emerging Industries of the Strategic Basic Research Project under Grants JCYJ20160226191842793 and JCYJ20170302154254147, in part by Natural Science Foundation of SZU (grant no. 2017031), in part by the Project 2016049 supported by SZU R/D Fund, in part by the Tencent “Rhinoceros Birds”-Scientific Research Foundation for Young Teachers of Shenzhen University, and in part by a grant from the Shenzhen Research Institute, City University of Hong Kong.

Keywords

  • Human visual system (HVS)
  • Quaternion representation (QR)
  • Stereoscopic image quality assessment (SIQA)
  • Visual saliency

Fingerprint

Dive into the research topics of 'Quaternion representation based visual saliency for stereoscopic image quality assessment'. Together they form a unique fingerprint.

Cite this