Rate distortion optimization with adaptive content modeling for random-access versatile video coding

Yi CHEN, Shiqi WANG, Horace IP, Sam KWONG*

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

3 Citations (Scopus)


In this paper, we study the capability of improving the rate-distortion (RD) performance based on the adaptive content modeling in the Versatile Video Coding (VVC) standard. In particular, the frame-level dependent relationships and inherent RD relationship are explored. As such, the rate dependency, distortion dependency and inherent RD characteristics are fully utilized in the global rate distortion optimization (RDO) process, and the quantization parameter (QP) for each frame could be adaptively solved. To facilitate the adaptive QP calculation, a two-pass coding strategy is proposed. In the first-pass coding, the video statistics are sufficiently collected with the proposed Dual Motion Compensation and Residual Coding (DMCRC) method to generate the parameters for the content-aware models. During the second-pass coding, the optimal QP at the frame level is obtained by optimizing the global RD performance with the dependent and inherent models. The proposed algorithm is implemented on VVC test model (VTM-4.0) and achieves significant performance gain for test sequences with constant and varying scenes.

Original languageEnglish
Article number119325
JournalInformation Sciences
Early online date22 Jun 2023
Publication statusPublished - Oct 2023
Externally publishedYes

Bibliographical note

Funding Information:
The authors would like to thank the editor and anonymous reviewers for their valuable comments that significantly helped us in improving the presentation of this paper. This work was supported in part by the Hong Kong Innovation and Technology Commission (InnoHK Project CIMDA), and in part by the Hong Kong GRF-RGC General Research Fund under Grant 11209819 (CityU 9042816 ) and Grant 11203820 ( 9042598 ).

Publisher Copyright:
© 2023 Elsevier Inc.


  • Adaptive QP selection
  • Inter-frame dependency
  • Quantization parameter
  • Rate-distortion optimization
  • Versatile video coding


Dive into the research topics of 'Rate distortion optimization with adaptive content modeling for random-access versatile video coding'. Together they form a unique fingerprint.

Cite this