A novel distortion model and lagrangian multiplier for depth maps coding

Hui YUAN, Sam KWONG, Ju LIU, Jiande SUN

Research output: Journal PublicationsJournal Article (refereed)peer-review

45 Citations (Scopus)

Abstract

In three-dimensional videos (3-DV) coding systems, depth maps are not used for viewing but for rendering virtual views. Therefore, the traditional rate distortion criterion (including distortion criterion, and Lagrangian multiplier) is not suitable for depth map coding. In order to design an effective rate distortion criterion for depth maps, the relationship between the distortion of synthesized virtual view and the coding error of depth maps is analyzed in detail. Through the analysis, a polynomial model revealing the relationship between the coding error of depth maps and the distortion of synthesized virtual view is derived. Model parameters are estimated by utilizing camera parameters and features of the texture video corresponding to the depth map. Based on the model, a virtual view-based Lagrangian multiplier for depth map coding is also proposed. Experimental results demonstrated the accuracy of the model. The squared correlation coefficients between the actual distortion of virtual view and the estimated distortion are all larger than 0.98 for all tested sequences. When incorporating the proposed model and Lagrangian multiplier into the mode decision procedure of joint model version 18.5 (JM18.5) of H.264/AVC, a maximum 0.470 dB BD PSNR and an average 0.251 dB BD PSNR can be achieved. © 2014 IEEE.
Original languageEnglish
Pages (from-to)443-451
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume24
Issue number3
Early online date29 Aug 2013
DOIs
Publication statusPublished - Mar 2014
Externally publishedYes

Funding

This work was supported in part by the National Basic Research Program (973 Program) of China under Grant 2009CB320905; in part by the National Natural Science Foundation of China under Grants 61272289, 61201211, and 61001180; in part by the Hong Kong Scholar Project under Grant XJ2012029; in part by the CityU Strategic Research Grant (SRG) under Grant 7002729; in part by the Ph.D. Programs Foundation, Ministry of Education of China under Grant 20120131120032; in part by the Excellent Youth Scientist Award Foundation of Shandong Province under Grants BS2012DX021 and BS2012DX020; in part by the China Postdoctoral Science Foundation Funded Project under Grant 2013M53032; in part by the China Postdoctoral Special Fundation Funded Project under Grant 2012T50629; in part by the Shandong Postdoctoral Innovation Project Fund under Grant 201203053; and in part by the open research fund of Key Laboratory of Wireless Sensor Network and Communication under Grant 2013002.

Keywords

  • 3-D
  • depth maps
  • distortion model
  • mode decision
  • rate distortion optimization
  • video coding

Fingerprint

Dive into the research topics of 'A novel distortion model and lagrangian multiplier for depth maps coding'. Together they form a unique fingerprint.

Cite this