A Hybrid Control Scheme for 360-Degree Dynamic Adaptive Video Streaming over Mobile Devices

Xuekai WEI, Mingliang ZHOU, Sam KWONG, Hui YUAN, Weijia JIA

Research output: Journal PublicationsJournal Article (refereed)peer-review

17 Citations (Scopus)

Abstract

A 360-degree streaming system can provide immersive, interactive, and autonomous experiences surrounding the user by means of viewpoint changes to see different angles of a 360-degree video. However, due to the limited capacity and highly dynamic conditions of cellular networks, high-resolution 360-degree video playback over mobile devices often suffers from playback freezing, and bandwidth waste is inevitably incurred in delivering out-of-view video data. In this paper, a hybrid control scheme is presented for segment-level continuous bitrate selection and tile-level bitrate allocation for 360-degree streaming over mobile devices to increase users' quality of experience. First, a deep reinforcement learning (RL) method is proposed to predict the segment bitrate and avoid playback freezing. Second, a viewpoint-prediction-map-based cooperative bargaining game theory is proposed for bitrate allocation optimization to choose a suitable bitrate for each tile to reduce unreasonable bandwidth waste. The proposed scheme is compared with state-of-the-art approaches under a wide variety of mobile network conditions with multiple viewpoint traces and 360-degree video contents. The experimental results indicate that the proposed method outperforms the compared state-of-the-art approaches in terms of various experimental objectives on mobile devices.

Original languageEnglish
Pages (from-to)3428-3442
Number of pages15
JournalIEEE Transactions on Mobile Computing
Volume21
Issue number10
Early online date9 Feb 2021
DOIs
Publication statusPublished - 1 Oct 2022
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2002-2012 IEEE.

Keywords

  • 360-degree streaming systems
  • game theory
  • quality of experience
  • reinforcement learning

Fingerprint

Dive into the research topics of 'A Hybrid Control Scheme for 360-Degree Dynamic Adaptive Video Streaming over Mobile Devices'. Together they form a unique fingerprint.

Cite this