Skip to main navigation Skip to search Skip to main content

Advancing user quality of experience in 360-degree video streaming

  • Stony Brook University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

43 Scopus citations

Abstract

Conventional streaming solutions for streaming 360-degree panoramic videos are inefficient in that they download the entire 360-degree panoramic scene, while the user views only a small sub-part of the scene called the viewport. This can waste over 80% of the network bandwidth. We develop a comprehensive approach called Mosaic that combines a powerful neural network-based viewport prediction with a rate control mechanism that assigns rates to different tiles in the 360-degree frame such that the video quality of experience is optimized subject to a given network capacity. We model the optimization as a multi-choice knapsack problem and solve it using a greedy approach. We also develop an end-To-end testbed using standards-compliant components and provide a comprehensive performance evaluation of Mosaic along with four other streaming techniques-Two for conventional adaptive video streaming and two for 360-degree tile-based video streaming. Mosaic outperforms the best of the competition by as much as 50% in terms of median video quality.

Original languageEnglish
Title of host publication2019 IFIP Networking Conference, IFIP Networking 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9783903176164
DOIs
StatePublished - May 2019
Event2019 IFIP Networking Conference, IFIP Networking 2019 - Warsaw, Poland
Duration: May 20 2019May 22 2019

Publication series

Name2019 IFIP Networking Conference, IFIP Networking 2019

Conference

Conference2019 IFIP Networking Conference, IFIP Networking 2019
Country/TerritoryPoland
CityWarsaw
Period05/20/1905/22/19

Keywords

  • 360-degree video streaming
  • adaptive video streaming
  • Convolutional Neural Network (CNN)
  • MPEG-DASH
  • Recurrent Neural Network (RNN)

Fingerprint

Dive into the research topics of 'Advancing user quality of experience in 360-degree video streaming'. Together they form a unique fingerprint.

Cite this