Regional bit allocation and rate distortion optimization for multiview depth video coding with view synthesis distortion model

Yun ZHANG; Sam KWONG; Long XU; Sudeng HU; Gangyi JIANG; C.-C. Jay KUO

doi:10.1109/TIP.2013.2265883

Regional bit allocation and rate distortion optimization for multiview depth video coding with view synthesis distortion model

Yun ZHANG, Sam KWONG, Long XU, Sudeng HU, Gangyi JIANG, C.-C. Jay KUO

Research output: Journal Publications › Journal Article (refereed) › peer-review

51 Citations (Scopus)

Abstract

In this paper, we propose a view synthesis distortion model (VSDM) that establishes the relationship between depth distortion and view synthesis distortion for the regions with different characteristics: color texture area corresponding depth (CTAD) region and color smooth area corresponding depth (CSAD), respectively. With this VSDM, we propose regional bit allocation (RBA) and rate distortion optimization (RDO) algorithms for multiview depth video coding (MDVC) by allocating more bits on CTAD for rendering quality and fewer bits on CSAD for compression efficiency. Experimental results show that the proposed VSDM based RBA and RDO can improve the coding efficiency significantly for the test sequences. In addition, for the proposed overall MDVC algorithm that integrates VSDM based RBA and RDO, it achieves 9.99% and 14.51% bit rate reduction on average for the high and low bit rate, respectively. It can improve virtual view image quality 0.22 and 0.24 dB on average at the high and low bit rate, respectively, when compared with the original joint multiview video coding model. The RD performance comparisons using five different metrics also validate the effectiveness of the proposed overall algorithm. In addition, the proposed algorithms can be applied to both INTRA and INTER frames. © 2013 IEEE.

Original language	English
Pages (from-to)	3497-3512
Journal	IEEE Transactions on Image Processing
Volume	22
Issue number	9
Early online date	3 Jun 2013
DOIs	https://doi.org/10.1109/TIP.2013.2265883
Publication status	Published - Sept 2013
Externally published	Yes

Bibliographical note

The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Karsten Mueller.

Funding

This work was supported in part by the Hong Kong RGC General Research Fund under Project 9041495 (CityU 115109), the Natural Science Foundation of China under Grants 61102088, 61272289 and 61202242, Shenzhen Emerging Industries of the Strategic Basic Research Project under Grant JCYJ20120617151719115, and the Guangdong Nature Science Foundation under Grant S2012010008457.

Keywords

bit allocation
Multiview depth video
rate-distortion optimization
view synthesis distortion model

Access to Document

10.1109/TIP.2013.2265883

Cite this

@article{4df4eb2023b847bf9e9c675d34d5d806,

title = "Regional bit allocation and rate distortion optimization for multiview depth video coding with view synthesis distortion model",

abstract = "In this paper, we propose a view synthesis distortion model (VSDM) that establishes the relationship between depth distortion and view synthesis distortion for the regions with different characteristics: color texture area corresponding depth (CTAD) region and color smooth area corresponding depth (CSAD), respectively. With this VSDM, we propose regional bit allocation (RBA) and rate distortion optimization (RDO) algorithms for multiview depth video coding (MDVC) by allocating more bits on CTAD for rendering quality and fewer bits on CSAD for compression efficiency. Experimental results show that the proposed VSDM based RBA and RDO can improve the coding efficiency significantly for the test sequences. In addition, for the proposed overall MDVC algorithm that integrates VSDM based RBA and RDO, it achieves 9.99% and 14.51% bit rate reduction on average for the high and low bit rate, respectively. It can improve virtual view image quality 0.22 and 0.24 dB on average at the high and low bit rate, respectively, when compared with the original joint multiview video coding model. The RD performance comparisons using five different metrics also validate the effectiveness of the proposed overall algorithm. In addition, the proposed algorithms can be applied to both INTRA and INTER frames. {\textcopyright} 2013 IEEE.",

keywords = "bit allocation, Multiview depth video, rate-distortion optimization, view synthesis distortion model",

author = "Yun ZHANG and Sam KWONG and Long XU and Sudeng HU and Gangyi JIANG and KUO, {C.-C. Jay}",

note = "The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Karsten Mueller.",

year = "2013",

month = sep,

doi = "10.1109/TIP.2013.2265883",

language = "English",

volume = "22",

pages = "3497--3512",

journal = "IEEE Transactions on Image Processing",

issn = "1057-7149",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "9",

}

TY - JOUR

T1 - Regional bit allocation and rate distortion optimization for multiview depth video coding with view synthesis distortion model

AU - ZHANG, Yun

AU - KWONG, Sam

AU - XU, Long

AU - HU, Sudeng

AU - JIANG, Gangyi

AU - KUO, C.-C. Jay

N1 - The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Karsten Mueller.

PY - 2013/9

Y1 - 2013/9

N2 - In this paper, we propose a view synthesis distortion model (VSDM) that establishes the relationship between depth distortion and view synthesis distortion for the regions with different characteristics: color texture area corresponding depth (CTAD) region and color smooth area corresponding depth (CSAD), respectively. With this VSDM, we propose regional bit allocation (RBA) and rate distortion optimization (RDO) algorithms for multiview depth video coding (MDVC) by allocating more bits on CTAD for rendering quality and fewer bits on CSAD for compression efficiency. Experimental results show that the proposed VSDM based RBA and RDO can improve the coding efficiency significantly for the test sequences. In addition, for the proposed overall MDVC algorithm that integrates VSDM based RBA and RDO, it achieves 9.99% and 14.51% bit rate reduction on average for the high and low bit rate, respectively. It can improve virtual view image quality 0.22 and 0.24 dB on average at the high and low bit rate, respectively, when compared with the original joint multiview video coding model. The RD performance comparisons using five different metrics also validate the effectiveness of the proposed overall algorithm. In addition, the proposed algorithms can be applied to both INTRA and INTER frames. © 2013 IEEE.

AB - In this paper, we propose a view synthesis distortion model (VSDM) that establishes the relationship between depth distortion and view synthesis distortion for the regions with different characteristics: color texture area corresponding depth (CTAD) region and color smooth area corresponding depth (CSAD), respectively. With this VSDM, we propose regional bit allocation (RBA) and rate distortion optimization (RDO) algorithms for multiview depth video coding (MDVC) by allocating more bits on CTAD for rendering quality and fewer bits on CSAD for compression efficiency. Experimental results show that the proposed VSDM based RBA and RDO can improve the coding efficiency significantly for the test sequences. In addition, for the proposed overall MDVC algorithm that integrates VSDM based RBA and RDO, it achieves 9.99% and 14.51% bit rate reduction on average for the high and low bit rate, respectively. It can improve virtual view image quality 0.22 and 0.24 dB on average at the high and low bit rate, respectively, when compared with the original joint multiview video coding model. The RD performance comparisons using five different metrics also validate the effectiveness of the proposed overall algorithm. In addition, the proposed algorithms can be applied to both INTRA and INTER frames. © 2013 IEEE.

KW - bit allocation

KW - Multiview depth video

KW - rate-distortion optimization

KW - view synthesis distortion model

UR - http://www.scopus.com/inward/record.url?scp=84882348897&partnerID=8YFLogxK

U2 - 10.1109/TIP.2013.2265883

DO - 10.1109/TIP.2013.2265883

M3 - Journal Article (refereed)

SN - 1057-7149

VL - 22

SP - 3497

EP - 3512

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

IS - 9

ER -

Regional bit allocation and rate distortion optimization for multiview depth video coding with view synthesis distortion model

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this