Recent Advances in Rate Control: From Optimisation to Implementation and Beyond

Xuekai WEI; Mingliang ZHOU; Heqiang WANG; Haoyan YANG; Lei CHEN; Sam KWONG

doi:10.1109/TCSVT.2023.3287561

Recent Advances in Rate Control: From Optimisation to Implementation and Beyond

Xuekai WEI, Mingliang ZHOU, Heqiang WANG, Haoyan YANG, Lei CHEN, Sam KWONG

Research output: Journal Publications › Journal Article (refereed) › peer-review

5 Citations (Scopus)

Abstract

Video coding is a video compression technique that compresses the original video sequence to produce a smaller archive file or reduce the transmission bandwidth under constraints on the visual quality loss. Rate control (RC) plays a critical role in video coding. It can achieve stable stream output in practical applications, especially real-time video applications such as video conferencing or game live streaming. Most RC algorithms either directly or indirectly characterise the relationship between the bit rate (R) and quantisation (Q) and then allocate bits to every coding unit so as to guarantee the global bit rate and video quality level. This paper comprehensively reviews the classic RC technologies used in international video standards of past generations, analyses the mathematical models and implementation mechanisms of various schemes, and compares the performance of recent state-of-the-art RC algorithms. Finally, we discuss future directions and new application areas for RC methods. We hope that this review can help support the development, implementation, and application of RC for new video coding standards.

Original language	English
Journal	IEEE Transactions on Circuits and Systems for Video Technology
DOIs	https://doi.org/10.1109/TCSVT.2023.3287561
Publication status	E-pub ahead of print - 19 Jun 2023
Externally published	Yes

Bibliographical note

Publisher Copyright:
IEEE

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 62176027; in part by the General Program of the National Natural Science Foundation of Chongqing under Grant cstc2020jcyj-msxmX0790; in part by the Human Resources and Social Security Bureau Project of Chongqing under Grant cx2020073; in part by the Hong Kong General Research Fund (GRF)- University Grants Committee (RGC) under Grant 11209819, Grant CityU 9042816, Grant 11203820, and Grant CityU 9042598; and in part by the Hong Kong Innovation and Technology Commission, Innovation and Technology Commission of Hong Kong (InnoHK) Project Centre for Intelligent Multidimensional Data Analysis (CIMDA).

Keywords

Adaptation models
AVC
Bit rate
Encoding
HEVC
Integrated circuit modeling
rate control
Standards
Streaming media
Video coding
VVC

Access to Document

10.1109/TCSVT.2023.3287561

Cite this

@article{aaa178969f3e432992502380c796e9f3,

title = "Recent Advances in Rate Control: From Optimisation to Implementation and Beyond",

abstract = "Video coding is a video compression technique that compresses the original video sequence to produce a smaller archive file or reduce the transmission bandwidth under constraints on the visual quality loss. Rate control (RC) plays a critical role in video coding. It can achieve stable stream output in practical applications, especially real-time video applications such as video conferencing or game live streaming. Most RC algorithms either directly or indirectly characterise the relationship between the bit rate (R) and quantisation (Q) and then allocate bits to every coding unit so as to guarantee the global bit rate and video quality level. This paper comprehensively reviews the classic RC technologies used in international video standards of past generations, analyses the mathematical models and implementation mechanisms of various schemes, and compares the performance of recent state-of-the-art RC algorithms. Finally, we discuss future directions and new application areas for RC methods. We hope that this review can help support the development, implementation, and application of RC for new video coding standards.",

keywords = "Adaptation models, AVC, Bit rate, Encoding, HEVC, Integrated circuit modeling, rate control, Standards, Streaming media, Video coding, VVC",

author = "Xuekai WEI and Mingliang ZHOU and Heqiang WANG and Haoyan YANG and Lei CHEN and Sam KWONG",

note = "Publisher Copyright: IEEE",

year = "2023",

month = jun,

day = "19",

doi = "10.1109/TCSVT.2023.3287561",

language = "English",

journal = "IEEE Transactions on Circuits and Systems for Video Technology",

issn = "1051-8215",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Recent Advances in Rate Control: From Optimisation to Implementation and Beyond

AU - WEI, Xuekai

AU - ZHOU, Mingliang

AU - WANG, Heqiang

AU - YANG, Haoyan

AU - CHEN, Lei

AU - KWONG, Sam

N1 - Publisher Copyright: IEEE

PY - 2023/6/19

Y1 - 2023/6/19

N2 - Video coding is a video compression technique that compresses the original video sequence to produce a smaller archive file or reduce the transmission bandwidth under constraints on the visual quality loss. Rate control (RC) plays a critical role in video coding. It can achieve stable stream output in practical applications, especially real-time video applications such as video conferencing or game live streaming. Most RC algorithms either directly or indirectly characterise the relationship between the bit rate (R) and quantisation (Q) and then allocate bits to every coding unit so as to guarantee the global bit rate and video quality level. This paper comprehensively reviews the classic RC technologies used in international video standards of past generations, analyses the mathematical models and implementation mechanisms of various schemes, and compares the performance of recent state-of-the-art RC algorithms. Finally, we discuss future directions and new application areas for RC methods. We hope that this review can help support the development, implementation, and application of RC for new video coding standards.

AB - Video coding is a video compression technique that compresses the original video sequence to produce a smaller archive file or reduce the transmission bandwidth under constraints on the visual quality loss. Rate control (RC) plays a critical role in video coding. It can achieve stable stream output in practical applications, especially real-time video applications such as video conferencing or game live streaming. Most RC algorithms either directly or indirectly characterise the relationship between the bit rate (R) and quantisation (Q) and then allocate bits to every coding unit so as to guarantee the global bit rate and video quality level. This paper comprehensively reviews the classic RC technologies used in international video standards of past generations, analyses the mathematical models and implementation mechanisms of various schemes, and compares the performance of recent state-of-the-art RC algorithms. Finally, we discuss future directions and new application areas for RC methods. We hope that this review can help support the development, implementation, and application of RC for new video coding standards.

KW - Adaptation models

KW - AVC

KW - Bit rate

KW - Encoding

KW - HEVC

KW - Integrated circuit modeling

KW - rate control

KW - Standards

KW - Streaming media

KW - Video coding

KW - VVC

UR - http://www.scopus.com/inward/record.url?scp=85163545033&partnerID=8YFLogxK

U2 - 10.1109/TCSVT.2023.3287561

DO - 10.1109/TCSVT.2023.3287561

M3 - Journal Article (refereed)

AN - SCOPUS:85163545033

SN - 1051-8215

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

ER -

Recent Advances in Rate Control: From Optimisation to Implementation and Beyond

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Adaptive Dynamic Range Enhancement Oriented to High Dynamic Display (面向高動態顯示的自適應動態範圍增強)

Cite this

Recent Advances in Rate Control: From Optimisation to Implementation and Beyond

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Projects

Adaptive Dynamic Range Enhancement Oriented to High Dynamic Display (面向高動態顯示的自適應動態範圍增強)

Cite this