Perceptually Weighted Mean Squared Error Based Rate-Distortion Optimization for HEVC

Xiuzhe WU; Hanli WANG; Sudeng HU; Sam KWONG; C.-C. Jay KUO

doi:10.1109/TBC.2020.3028322

Perceptually Weighted Mean Squared Error Based Rate-Distortion Optimization for HEVC

Xiuzhe WU, Hanli WANG, Sudeng HU, Sam KWONG, C.-C. Jay KUO

Research output: Journal Publications › Journal Article (refereed) › peer-review

8 Citations (Scopus)

Abstract

The process of rate-distortion (RD) optimization plays a key role for video coding, which aims to achieve a tradeoff between compression efficiency and video quality distortion. Although the conventional objective distortion metric mean squared error performs well in computational complexity, it is not always in accordance with the perceptual quality perceived by human visual system (HVS). Taking the characteristics of HVS into consideration, a perceptually weighted mean squared error (PWMSE) based RD model is proposed in this work. First, a low-pass filter is employed to process the original distortion information in order to simulate visual signal processing and obtain the perceptual distortion. Then, masking modulation in both temporal and spatial domains is introduced into distortion model, and a novel Lagrange multiplier is derived accordingly. The proposed PWMSE based RD model is applied to the high efficiency video coding standard, and comparative experimental results demonstrate its effectiveness. The project page can be found in https://mic.tongji.edu.cn/ab/40/c9778a174912/page.htm.

Original language	English
Pages (from-to)	824-834
Journal	IEEE Transactions on Broadcasting
Volume	66
Issue number	4
Early online date	20 Oct 2020
DOIs	https://doi.org/10.1109/TBC.2020.3028322
Publication status	Published - Dec 2020
Externally published	Yes

Bibliographical note

This work was supported in part by National Natural Science Foundation of China under Grant 61976159; in part by Shanghai Innovation Action Project of Science and Technology under Grant 20511100700; and in part by Shanghai Engineering Research Center of Industrial Vision Perception and Intelligent Computing under Grant 17DZ2251600. (Xiuzhe Wu and Hanli Wang are co-first authors.)

Keywords

high efficiency video coding
Perceptual video coding
perceptually weighted mean squared error
rate-distortion optimization

Access to Document

10.1109/TBC.2020.3028322

Cite this

@article{3ef3f77e28fd4891a6f40aec379e73ac,

title = "Perceptually Weighted Mean Squared Error Based Rate-Distortion Optimization for HEVC",

abstract = "The process of rate-distortion (RD) optimization plays a key role for video coding, which aims to achieve a tradeoff between compression efficiency and video quality distortion. Although the conventional objective distortion metric mean squared error performs well in computational complexity, it is not always in accordance with the perceptual quality perceived by human visual system (HVS). Taking the characteristics of HVS into consideration, a perceptually weighted mean squared error (PWMSE) based RD model is proposed in this work. First, a low-pass filter is employed to process the original distortion information in order to simulate visual signal processing and obtain the perceptual distortion. Then, masking modulation in both temporal and spatial domains is introduced into distortion model, and a novel Lagrange multiplier is derived accordingly. The proposed PWMSE based RD model is applied to the high efficiency video coding standard, and comparative experimental results demonstrate its effectiveness. The project page can be found in https://mic.tongji.edu.cn/ab/40/c9778a174912/page.htm.",

keywords = "high efficiency video coding, Perceptual video coding, perceptually weighted mean squared error, rate-distortion optimization",

author = "Xiuzhe WU and Hanli WANG and Sudeng HU and Sam KWONG and KUO, {C.-C. Jay}",

note = "This work was supported in part by National Natural Science Foundation of China under Grant 61976159; in part by Shanghai Innovation Action Project of Science and Technology under Grant 20511100700; and in part by Shanghai Engineering Research Center of Industrial Vision Perception and Intelligent Computing under Grant 17DZ2251600. (Xiuzhe Wu and Hanli Wang are co-first authors.)",

year = "2020",

month = dec,

doi = "10.1109/TBC.2020.3028322",

language = "English",

volume = "66",

pages = "824--834",

journal = "IEEE Transactions on Broadcasting",

issn = "0018-9316",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "4",

}

TY - JOUR

T1 - Perceptually Weighted Mean Squared Error Based Rate-Distortion Optimization for HEVC

AU - WU, Xiuzhe

AU - WANG, Hanli

AU - HU, Sudeng

AU - KWONG, Sam

AU - KUO, C.-C. Jay

N1 - This work was supported in part by National Natural Science Foundation of China under Grant 61976159; in part by Shanghai Innovation Action Project of Science and Technology under Grant 20511100700; and in part by Shanghai Engineering Research Center of Industrial Vision Perception and Intelligent Computing under Grant 17DZ2251600. (Xiuzhe Wu and Hanli Wang are co-first authors.)

PY - 2020/12

Y1 - 2020/12

N2 - The process of rate-distortion (RD) optimization plays a key role for video coding, which aims to achieve a tradeoff between compression efficiency and video quality distortion. Although the conventional objective distortion metric mean squared error performs well in computational complexity, it is not always in accordance with the perceptual quality perceived by human visual system (HVS). Taking the characteristics of HVS into consideration, a perceptually weighted mean squared error (PWMSE) based RD model is proposed in this work. First, a low-pass filter is employed to process the original distortion information in order to simulate visual signal processing and obtain the perceptual distortion. Then, masking modulation in both temporal and spatial domains is introduced into distortion model, and a novel Lagrange multiplier is derived accordingly. The proposed PWMSE based RD model is applied to the high efficiency video coding standard, and comparative experimental results demonstrate its effectiveness. The project page can be found in https://mic.tongji.edu.cn/ab/40/c9778a174912/page.htm.

AB - The process of rate-distortion (RD) optimization plays a key role for video coding, which aims to achieve a tradeoff between compression efficiency and video quality distortion. Although the conventional objective distortion metric mean squared error performs well in computational complexity, it is not always in accordance with the perceptual quality perceived by human visual system (HVS). Taking the characteristics of HVS into consideration, a perceptually weighted mean squared error (PWMSE) based RD model is proposed in this work. First, a low-pass filter is employed to process the original distortion information in order to simulate visual signal processing and obtain the perceptual distortion. Then, masking modulation in both temporal and spatial domains is introduced into distortion model, and a novel Lagrange multiplier is derived accordingly. The proposed PWMSE based RD model is applied to the high efficiency video coding standard, and comparative experimental results demonstrate its effectiveness. The project page can be found in https://mic.tongji.edu.cn/ab/40/c9778a174912/page.htm.

KW - high efficiency video coding

KW - Perceptual video coding

KW - perceptually weighted mean squared error

KW - rate-distortion optimization

UR - http://www.scopus.com/inward/record.url?scp=85096112444&partnerID=8YFLogxK

U2 - 10.1109/TBC.2020.3028322

DO - 10.1109/TBC.2020.3028322

M3 - Journal Article (refereed)

SN - 0018-9316

VL - 66

SP - 824

EP - 834

JO - IEEE Transactions on Broadcasting

JF - IEEE Transactions on Broadcasting

IS - 4

ER -

Perceptually Weighted Mean Squared Error Based Rate-Distortion Optimization for HEVC

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this