Spatial and Temporal Consistency-Aware Dynamic Adaptive Streaming for 360-Degree Videos

Hui YUAN, Shiyun ZHAO, Junhui HOU, Xuekai WEI, Sam KWONG

Research output: Journal PublicationsJournal Article (refereed)peer-review

37 Citations (Scopus)

Abstract

The 360-degree video allows users to enjoy the whole scene by interactively switching viewports. However, the huge data volume of the 360-degree video limits its remote applications via network. To provide high quality of experience (QoE) for remote web users, this paper presents a tile-based adaptive streaming method for 360-degree videos. First, we propose a simple yet effective rate adaptation algorithm to determine the requested bitrate for downloading the current video segment by considering the balance between the buffer length and video quality. Then, we propose to use a Gaussian model to predict the field of view at the beginning of each requested video segment. To deal with the circumstance that the view angle is switched during the display of a video segment, we propose to download all the tiles in the 360-degree video with different priorities based on a Zipf model. Finally, in order to allocate bitrates for all the tiles, a two-stage optimization algorithm is proposed to preserve the quality of tiles in FoV and guarantee the spatial and temporal smoothness. Experimental results demonstrate the effectiveness and advantage of the proposed method compared with the state-of-the-art methods. That is, our method preserves both the quality and the smoothness of tiles in FoV, thus providing the best QoE for users.
Original languageEnglish
Pages (from-to)177-193
Number of pages17
JournalIEEE Journal on Selected Topics in Signal Processing
Volume14
Issue number1
Early online date6 Dec 2019
DOIs
Publication statusPublished - Jan 2020
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 61571274 and Grant 61871342, in part by the Shandong Natural Science Funds for Distinguished Young Scholar under Grant JQ201614, in part by the National Key R&D Program of China under Grant 2018YFC0831003, and in part by the Young Scholars Program of Shandong University under Grant 2015WLJH39.

Keywords

  • 360-degree video
  • Bit rate
  • DASH
  • field of view
  • Prediction algorithms
  • Quality of experience
  • quality of experience
  • rate adaptation
  • Signal processing algorithms
  • Switches
  • Throughput
  • video compression
  • Videos

Fingerprint

Dive into the research topics of 'Spatial and Temporal Consistency-Aware Dynamic Adaptive Streaming for 360-Degree Videos'. Together they form a unique fingerprint.

Cite this