λ-Domain Rate Control via Wavelet-Based Residual Neural Network for VVC HDR Intra Coding

Feng YUAN, Jianjun LEI, Zhaoqing PAN, Bo PENG, Haoran XIE

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

High dynamic range (HDR) video offers a more realistic visual experience than standard dynamic range (SDR) video, while introducing new challenges to both compression and transmission. Rate control is an effective technology to overcome these challenges, and ensure optimal HDR video delivery. However, the rate control algorithm in the latest video coding standard, versatile video coding (VVC), is tailored to SDR videos, and does not produce well coding results when encoding HDR videos. To address this problem, a data-driven λ-domain rate control algorithm is proposed for VVC HDR intra frames in this paper. First, the coding characteristics of HDR intra coding are analyzed, and a piecewise R -λ model is proposed to accurately determine the correlation between the rate ( R ) and the Lagrange parameter λ for HDR intra frames. Then, to optimize bit allocation at the coding tree unit (CTU)-level, a wavelet-based residual neural network (WRNN) is developed to accurately predict the parameters of the piecewise R -λ model for each CTU. Third, a large-scale HDR dataset is established for training WRNN, which facilitates the applications of deep learning in HDR intra coding. Extensive experimental results show that our proposed HDR intra frame rate control algorithm achieves superior coding results than the state-of-the-art algorithms.
Original languageEnglish
Pages (from-to)6189-6203
Number of pages15
JournalIEEE Transactions on Image Processing
Volume33
DOIs
Publication statusE-pub ahead of print - 25 Oct 2024

Fingerprint

Dive into the research topics of 'λ-Domain Rate Control via Wavelet-Based Residual Neural Network for VVC HDR Intra Coding'. Together they form a unique fingerprint.

Cite this