Toward Low-Latency and High-Quality Adaptive 360° Streaming

Xuekai WEI, Mingliang ZHOU*, Weijia JIA

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

5 Citations (Scopus)

Abstract

Advanced 360° video streaming is essential for high-quality communication and industrial video applications, supporting novel and interactive visual experiences that promote consumption. However, due to the inherent fluctuations in communication networks, hardware resources, and power costs, a tradeoff needs to be achieved between occupying network bandwidth and guaranteeing 360° visual quality. To address this issue, this article proposes a quality-aware global optimization solution that combines different types of sensory characteristics to further enhance the 360° streaming efficiency in cellular networks. First, considering the characteristics of 360° video, each frame is divided into three different regions based on a proposed field-of-view prediction method. Second, a new region-based rate-distortion model reflecting the bitrate-quality relationship is proposed. The divided regions are represented by different rate-distortion models. In addition, a rate-distortion model parameter update strategy with robustness to region changes is proposed to further guarantee transmission performance. Finally, we propose a globally optimized adaptive bitrate allocation algorithm to optimize 360° mobile streaming, which uses both the rate-distortion models and viewpoint prediction results. Evaluation results indicate that the proposed method outperforms state-of-the-art approaches in terms of several quality of experience objectives under various network conditions.

Original languageEnglish
Pages (from-to)6326-6336
Number of pages11
JournalIEEE Transactions on Industrial Informatics
Volume19
Issue number5
DOIs
Publication statusPublished - May 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2005-2012 IEEE.

Keywords

  • 360° video
  • field of view (FoV)
  • industrial application
  • quality of experience (QoE)
  • rate-distortion
  • video streaming

Fingerprint

Dive into the research topics of 'Toward Low-Latency and High-Quality Adaptive 360° Streaming'. Together they form a unique fingerprint.

Cite this