Highly Efficient Multiview Depth Coding Based on Histogram Projection and Allowable Depth Distortion

Yun ZHANG, Linwei ZHU, Raouf HAMZAOUI, Sam KWONG, Yo-Sung HO

Research output: Journal PublicationsJournal Article (refereed)peer-review

7 Citations (Scopus)

Abstract

Mismatches between the precisions of representing the disparity, depth value and rendering position in 3D video systems cause redundancies in depth map representations. In this paper, we propose a highly efficient multiview depth coding scheme based on Depth Histogram Projection (DHP) and Allowable Depth Distortion (ADD) in view synthesis. Firstly, DHP exploits the sparse representation of depth maps generated from stereo matching to reduce the residual error from INTER and INTRA predictions in depth coding. We provide a mathematical foundation for DHP-based lossless depth coding by theoretically analyzing its rate-distortion cost. Then, due to the mismatch between depth value and rendering position, there is a many-to-one mapping relationship between them in view synthesis, which induces the ADD model. Based on this ADD model and DHP, depth coding with lossless view synthesis quality is proposed to further improve the compression performance of depth coding while maintaining the same synthesized video quality. Experimental results reveal that the proposed DHP based depth coding can achieve an average bit rate saving of 20.66% to 19.52% for lossless coding on Multiview High Efficiency Video Coding (MV-HEVC) with different groups of pictures. In addition, our depth coding based on DHP and ADD achieves an average depth bit rate reduction of 46.69%, 34.12% and 28.68% for lossless view synthesis quality when the rendering precision varies from integer, half to quarter pixels, respectively. We obtain similar gains for lossless depth coding on the 3D-HEVC, HEVC Intra coding and JPEG2000 platforms.
Original languageEnglish
Pages (from-to)402-417
JournalIEEE Transactions on Image Processing
Volume30
Early online date16 Nov 2020
DOIs
Publication statusPublished - 2021
Externally publishedYes

Bibliographical note

This work was supported in part by the Shenzhen Science and Technology Program under Grant JCYJ20180507183823045, in part by the Guangdong International Science and Technology Cooperative Research Project under Grant 2018A050506063, in part by the National Natural Science Foundation of China under Grant 61901459, in part by the China Postdoctoral Science Foundation under Grant 2019M653127, in part by the Membership of Youth Innovation Promotion Association, Chinese Academy of Sciences under Grant 2018392, and in part by the CAS President’s International Fellowship Initiative (PIFI) under Grant 2020VTA008.

Keywords

  • allowable depth distortion
  • depth coding
  • depth histogram projection
  • HEVC
  • Lossless coding
  • view synthesis

Fingerprint

Dive into the research topics of 'Highly Efficient Multiview Depth Coding Based on Histogram Projection and Allowable Depth Distortion'. Together they form a unique fingerprint.

Cite this