Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

Mingliang ZHOU; Xuekai WEI; Sam KWONG; Weijia JIA; Bin FANG

doi:10.1109/TIP.2020.3004714

Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

Mingliang ZHOU, Xuekai WEI, Sam KWONG, Weijia JIA, Bin FANG

Research output: Journal Publications › Journal Article (refereed) › peer-review

45 Citations (Scopus)

Abstract

In this paper, we propose a just noticeable distortion (JND)-based perceptual rate control method for high efficiency video coding (HEVC). First, the JND factor of a coding unit has been mathematically shown to be an approximation of the average pixel-level JND weight, which means that it can also be used as a weight for bitrate allocation. Second, rate-distortion (R-D) modelling is conducted based on the JND factor. Finally, the proposed R-D model is integrated into an existing rate control framework to improve the coding efficiency, and the proposed algorithm is implemented in the newest video coding standard. As the experimental results reveal, compared with HEVC reference software, our algorithm achieves significantly improved coding performance, subjective coding quality and bitrate accuracy.

Original language	English
Article number	9130045
Pages (from-to)	7603-7614
Number of pages	12
Journal	IEEE Transactions on Image Processing
Volume	29
Early online date	30 Jun 2020
DOIs	https://doi.org/10.1109/TIP.2020.3004714
Publication status	Published - 2020
Externally published	Yes

Bibliographical note

Publisher Copyright:
© 1992-2012 IEEE.

Funding

This work was supported in part by the Natural Science Foundation of China under Grant 61871342, Grant 61772344, Grant 61672443, and Grant 61876026, in part by the Hong Kong RGC General Research Funds under Grant 9042820 (CityU 11219019), Grant 9042489 (CityU 11206317), Grant 9042322 (CityU 11200116), and Grant 9048123 (CityU 21211518), in part by the Key Project of Science and Technology Innovation 2030 supported by the Ministry of Science and Technology of China under Grant 2018AAA0101301, in part by the startup project of Chongqing University under Grant 02160011044118, in part by the Guangxi Key Laboratory of Cryptography and Information Security under Grant GCIS201906, and in part by Chinese National Research Fund (NSFC) Key Project under Grant 61532013 and Grant 61872239.

Keywords

HEVC
Human visual perception
JND
perceptual rate control

Access to Document

10.1109/TIP.2020.3004714

Cite this

@article{160c50023f2a411e9fcfabdc44d9e5f9,

title = "Just Noticeable Distortion-Based Perceptual Rate Control in HEVC",

abstract = "In this paper, we propose a just noticeable distortion (JND)-based perceptual rate control method for high efficiency video coding (HEVC). First, the JND factor of a coding unit has been mathematically shown to be an approximation of the average pixel-level JND weight, which means that it can also be used as a weight for bitrate allocation. Second, rate-distortion (R-D) modelling is conducted based on the JND factor. Finally, the proposed R-D model is integrated into an existing rate control framework to improve the coding efficiency, and the proposed algorithm is implemented in the newest video coding standard. As the experimental results reveal, compared with HEVC reference software, our algorithm achieves significantly improved coding performance, subjective coding quality and bitrate accuracy.",

keywords = "HEVC, Human visual perception, JND, perceptual rate control",

author = "Mingliang ZHOU and Xuekai WEI and Sam KWONG and Weijia JIA and Bin FANG",

note = "Publisher Copyright: {\textcopyright} 1992-2012 IEEE.",

year = "2020",

doi = "10.1109/TIP.2020.3004714",

language = "English",

volume = "29",

pages = "7603--7614",

journal = "IEEE Transactions on Image Processing",

issn = "1057-7149",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

AU - ZHOU, Mingliang

AU - WEI, Xuekai

AU - KWONG, Sam

AU - JIA, Weijia

AU - FANG, Bin

PY - 2020

Y1 - 2020

N2 - In this paper, we propose a just noticeable distortion (JND)-based perceptual rate control method for high efficiency video coding (HEVC). First, the JND factor of a coding unit has been mathematically shown to be an approximation of the average pixel-level JND weight, which means that it can also be used as a weight for bitrate allocation. Second, rate-distortion (R-D) modelling is conducted based on the JND factor. Finally, the proposed R-D model is integrated into an existing rate control framework to improve the coding efficiency, and the proposed algorithm is implemented in the newest video coding standard. As the experimental results reveal, compared with HEVC reference software, our algorithm achieves significantly improved coding performance, subjective coding quality and bitrate accuracy.

AB - In this paper, we propose a just noticeable distortion (JND)-based perceptual rate control method for high efficiency video coding (HEVC). First, the JND factor of a coding unit has been mathematically shown to be an approximation of the average pixel-level JND weight, which means that it can also be used as a weight for bitrate allocation. Second, rate-distortion (R-D) modelling is conducted based on the JND factor. Finally, the proposed R-D model is integrated into an existing rate control framework to improve the coding efficiency, and the proposed algorithm is implemented in the newest video coding standard. As the experimental results reveal, compared with HEVC reference software, our algorithm achieves significantly improved coding performance, subjective coding quality and bitrate accuracy.

KW - HEVC

KW - Human visual perception

KW - JND

KW - perceptual rate control

UR - http://www.scopus.com/inward/record.url?scp=85088317332&partnerID=8YFLogxK

U2 - 10.1109/TIP.2020.3004714

DO - 10.1109/TIP.2020.3004714

M3 - Journal Article (refereed)

SN - 1057-7149

VL - 29

SP - 7603

EP - 7614

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

M1 - 9130045

ER -

Just Noticeable Distortion-Based Perceptual Rate Control in HEVC

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this