Tampere University of Technology

TUTCRIS Research Portal

Scalable bit allocation between texture and depth views for 3-D video streaming over heterogeneous networks

Research output: Contribution to journalArticleScientificpeer-review

Details

Original languageEnglish
Pages (from-to)139-152
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume25
Issue number1
DOIs
Publication statusPublished - 1 Jan 2015
Publication typeA1 Journal article-refereed

Abstract

In the multiview video plus depth (MVD) coding format, both texture and depth views are jointly compressed to represent the 3-D video content. The MVD format enables synthesis of virtual views through depth-image-based rendering; hence, distortion in the texture and depth views affects the quality of the synthesized virtual views. Bit allocation between texture and depth views has been studied with some promising results. However, to the best of our knowledge, most of the existing bit-allocation methods attempt to allocate a fixed amount of total bit rate between texture and depth views; that is, to select appropriate pair of quantization parameters for texture and depth views to maximize the synthesized view quality subject to a fixed total bit rate. In this paper we propose a scalable bit-allocation scheme, where a single ordering of texture and depth packets is derived and used to obtain optimal bit allocation between texture and depth views for any total target rates. In the proposed scheme, both texture and depth views are encoded using the quality scalable coding method; that is, medium grain scalable (MGS) coding of the Scalable Video Coding (SVC) extension of the Advanced Video Coding (H.264/AVC) standard. For varying target total bit rates, optimal bit truncation points for both texture and depth views can be obtained using the proposed scheme. Moreover, we propose to order the enhancement layer packets of the H.264/SVC MGS encoded depth view according to their contribution to the reduction of the synthesized view distortion. On one hand, this improves the depth view packet ordering when considered the rate-distortion performance of synthesized views, which is demonstrated by the experimental results. On the other hand, the information obtained in this step is used to facilitate optimal bit allocation between texture and depth views. Experimental results demonstrate the effectiveness of the proposed scalable bit-allocation scheme for texture and depth views.

Keywords

  • 3-D, 3-D scalability, 3-D streaming, Bit allocation, Depth view, Heterogeneous network, Medium grain scalable (MGS), Quality scalable, Synthesized view distortion, Texture view

Publication forum classification

Field of science, Statistics Finland