CTU-Level Rate Control with λ Optimization Based on Visual Gaze Mechanism for 360-Degree Versatile Video Coding

Zeming ZHAO; Meng WANG; Xiangjie SUI; Xiaohai HE; Shiqi WANG

doi:10.1109/ICIP55913.2025.11084566

CTU-Level Rate Control with λ Optimization Based on Visual Gaze Mechanism for 360-Degree Versatile Video Coding

Zeming ZHAO
, Meng WANG
, Xiangjie SUI
, Xiaohai HE
, Shiqi WANG

School of Data Science

Research output: Book Chapters | Papers in Conference Proceedings › Conference paper (refereed) › Referred Conference Paper › peer-review

Abstract

Understanding the human visual gaze mechanism is crucial for enhancing 360° video coding technology. This paper presents a Coding Tree Unit (CTU)-level rate control scheme with λ optimization strategy for 360° Versatile Video Coding (VVC), with the aim of enhancing rate-distortion performance and bitrate accuracy. Specifically, the Lagrange parameter λ is optimized with consideration of distortion dependency and the identification of key CTUs guided by visual gaze, which are derived from a 360° video path generation network, thoroughly integrating the characteristics of the human visual gaze. Experimental results show that the proposed scheme achieves BD-rate savings in terms of Weighted to Spherically uniform-Peak Signal-to-Noise Ratio (WS-PSNR) and Sphere-Peak Signal-to-Noise Ratio (S-PSNR) across various coding configurations.

Original language	English
Title of host publication	2025 IEEE International Conference on Image Processing, ICIP 2025 - Proceedings
Pages	641-646
Number of pages	6
ISBN (Electronic)	9798331523794
DOIs	https://doi.org/10.1109/ICIP55913.2025.11084566
Publication status	Published - 18 Aug 2025
Event	2025 IEEE International Conference on Image Processing (ICIP) - Anchorage, AK, USA, Alaska, United States Duration: 14 Sept 2025 → 17 Sept 2025

Publication series

Name	Proceedings - International Conference on Image Processing, ICIP
ISSN (Print)	1522-4880

Conference

Conference	2025 IEEE International Conference on Image Processing (ICIP)
Abbreviated title	ICIP
Country/Territory	United States
City	Alaska
Period	14/09/25 → 17/09/25

Bibliographical note

Publisher Copyright:
©2025 IEEE.

Funding

This work was supported in part by ITF Project GHP/044/21SZ; in part by RGC General Research Fund 11203220/11200323; in part by the National Natural Science Foundation of China (Grant No. 62271336 and Grant No. 62211530110) and in part by the Key Research and Development Program of Sichuan Province (Grant No. 2024YFHZ0289).

Keywords

360° video coding
distortion dependency
rate control
scanpath generator
λ optimization

Access to Document

10.1109/ICIP55913.2025.11084566

https://ieeexplore.ieee.org/document/11084566/

Cite this

ZHAO, Z., WANG, M., SUI, X., HE, X., & WANG, S. (2025). CTU-Level Rate Control with λ Optimization Based on Visual Gaze Mechanism for 360-Degree Versatile Video Coding. In 2025 IEEE International Conference on Image Processing, ICIP 2025 - Proceedings (pp. 641-646). (Proceedings - International Conference on Image Processing, ICIP). https://doi.org/10.1109/ICIP55913.2025.11084566

@inproceedings{a3269ae6423e4dd78cc443bb5f6b6ccc,

title = "CTU-Level Rate Control with λ Optimization Based on Visual Gaze Mechanism for 360-Degree Versatile Video Coding",

abstract = "Understanding the human visual gaze mechanism is crucial for enhancing 360° video coding technology. This paper presents a Coding Tree Unit (CTU)-level rate control scheme with λ optimization strategy for 360° Versatile Video Coding (VVC), with the aim of enhancing rate-distortion performance and bitrate accuracy. Specifically, the Lagrange parameter λ is optimized with consideration of distortion dependency and the identification of key CTUs guided by visual gaze, which are derived from a 360° video path generation network, thoroughly integrating the characteristics of the human visual gaze. Experimental results show that the proposed scheme achieves BD-rate savings in terms of Weighted to Spherically uniform-Peak Signal-to-Noise Ratio (WS-PSNR) and Sphere-Peak Signal-to-Noise Ratio (S-PSNR) across various coding configurations.",

keywords = "360° video coding, distortion dependency, rate control, scanpath generator, λ optimization",

author = "Zeming ZHAO and Meng WANG and Xiangjie SUI and Xiaohai HE and Shiqi WANG",

note = "Publisher Copyright: {\textcopyright}2025 IEEE.; 2025 IEEE International Conference on Image Processing (ICIP), ICIP ; Conference date: 14-09-2025 Through 17-09-2025",

year = "2025",

month = aug,

day = "18",

doi = "10.1109/ICIP55913.2025.11084566",

language = "English",

isbn = "9798331523794",

series = "Proceedings - International Conference on Image Processing, ICIP",

pages = "641--646",

booktitle = "2025 IEEE International Conference on Image Processing, ICIP 2025 - Proceedings",

}

ZHAO, Z, WANG, M, SUI, X, HE, X & WANG, S 2025, CTU-Level Rate Control with λ Optimization Based on Visual Gaze Mechanism for 360-Degree Versatile Video Coding. in 2025 IEEE International Conference on Image Processing, ICIP 2025 - Proceedings. Proceedings - International Conference on Image Processing, ICIP, pp. 641-646, 2025 IEEE International Conference on Image Processing (ICIP), Alaska, United States, 14/09/25. https://doi.org/10.1109/ICIP55913.2025.11084566

CTU-Level Rate Control with λ Optimization Based on Visual Gaze Mechanism for 360-Degree Versatile Video Coding. / ZHAO, Zeming; WANG, Meng; SUI, Xiangjie et al.
2025 IEEE International Conference on Image Processing, ICIP 2025 - Proceedings. 2025. p. 641-646 (Proceedings - International Conference on Image Processing, ICIP).

Research output: Book Chapters | Papers in Conference Proceedings › Conference paper (refereed) › Referred Conference Paper › peer-review

TY - GEN

T1 - CTU-Level Rate Control with λ Optimization Based on Visual Gaze Mechanism for 360-Degree Versatile Video Coding

AU - ZHAO, Zeming

AU - WANG, Meng

AU - SUI, Xiangjie

AU - HE, Xiaohai

AU - WANG, Shiqi

PY - 2025/8/18

Y1 - 2025/8/18

N2 - Understanding the human visual gaze mechanism is crucial for enhancing 360° video coding technology. This paper presents a Coding Tree Unit (CTU)-level rate control scheme with λ optimization strategy for 360° Versatile Video Coding (VVC), with the aim of enhancing rate-distortion performance and bitrate accuracy. Specifically, the Lagrange parameter λ is optimized with consideration of distortion dependency and the identification of key CTUs guided by visual gaze, which are derived from a 360° video path generation network, thoroughly integrating the characteristics of the human visual gaze. Experimental results show that the proposed scheme achieves BD-rate savings in terms of Weighted to Spherically uniform-Peak Signal-to-Noise Ratio (WS-PSNR) and Sphere-Peak Signal-to-Noise Ratio (S-PSNR) across various coding configurations.

AB - Understanding the human visual gaze mechanism is crucial for enhancing 360° video coding technology. This paper presents a Coding Tree Unit (CTU)-level rate control scheme with λ optimization strategy for 360° Versatile Video Coding (VVC), with the aim of enhancing rate-distortion performance and bitrate accuracy. Specifically, the Lagrange parameter λ is optimized with consideration of distortion dependency and the identification of key CTUs guided by visual gaze, which are derived from a 360° video path generation network, thoroughly integrating the characteristics of the human visual gaze. Experimental results show that the proposed scheme achieves BD-rate savings in terms of Weighted to Spherically uniform-Peak Signal-to-Noise Ratio (WS-PSNR) and Sphere-Peak Signal-to-Noise Ratio (S-PSNR) across various coding configurations.

KW - 360° video coding

KW - distortion dependency

KW - rate control

KW - scanpath generator

KW - λ optimization

UR - https://www.scopus.com/pages/publications/105028640644

U2 - 10.1109/ICIP55913.2025.11084566

DO - 10.1109/ICIP55913.2025.11084566

M3 - Conference paper (refereed)

SN - 9798331523794

T3 - Proceedings - International Conference on Image Processing, ICIP

SP - 641

EP - 646

BT - 2025 IEEE International Conference on Image Processing, ICIP 2025 - Proceedings

T2 - 2025 IEEE International Conference on Image Processing (ICIP)

Y2 - 14 September 2025 through 17 September 2025

ER -

CTU-Level Rate Control with λ Optimization Based on Visual Gaze Mechanism for 360-Degree Versatile Video Coding

Abstract

Publication series

Conference

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this