Tampere University of Technology

TUTCRIS Research Portal

Standard-compliant multiview video coding and streaming for virtual reality applications

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Details

Original languageEnglish
Title of host publication2016 IEEE International Symposium on Multimedia (ISM)
PublisherIEEE
Pages295-300
Number of pages6
ISBN (Electronic)9781509045709
DOIs
Publication statusPublished - 18 Jan 2017
Publication typeA4 Article in a conference publication
EventIEEE International Symposium on Multimedia -
Duration: 1 Jan 1900 → …

Conference

ConferenceIEEE International Symposium on Multimedia
Period1/01/00 → …

Abstract

Virtual reality (VR) systems employ multiview cameras or camera rigs to capture a scene from the entire 360- degree perspective. Due to computational or latency constraints, it might not be possible to stitch multiview videos into a single video sequence prior to encoding. In this paper we investigate the coding and streaming of multiview VR video content. We present a standard-compliant method where we first divide the camera views into two types: Primary views represent a subset of camera views with lower resolution and non-overlapping (minimally overlapping) content which cover the entire 360- degree field-of-view to guarantee immediate monoscopic viewing during very rapid head movements. Auxiliary views consist of remaining camera views with higher resolution which produce overlapping content with the primary views and are additionally used for stereoscopic viewing. Based on this categorization, we propose a coding arrangement in which, the primary views are independently coded in the base layer and the additional auxiliary views are coded as an enhancement layer, using inter-layer prediction from primary views. The proposed system not only meets the low latency requirements of VR systems, but also conforms to the existing multilayer extensions of the High Efficiency Video Coding standard. Simulation results show that the coding and streaming performance of the proposed scheme is significantly improved compared to earlier methods.

Keywords

  • Multiview video coding, Selective streaming, Virtual reality

Publication forum classification

Field of science, Statistics Finland