Tampere University of Technology

TUTCRIS Research Portal

Speed-optimized free-viewpoint rendering based on depth layering

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Details

Original languageEnglish
Title of host publication3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 2015
Pages1-4
Number of pages4
DOIs
Publication statusPublished - 1 Jul 2015
Publication typeA4 Article in a conference publication
Event3DTV Conference - , United States
Duration: 1 Jan 2000 → …

Conference

Conference3DTV Conference
CountryUnited States
Period1/01/00 → …

Abstract

In this paper free-viewpoint rendering is addressed and a new fast approach for virtual views synthesis from view-plus-depth 3D representation is proposed. Depth layering in disparity domain is employed in order to optimally approximate the scene geometry by a set of constant depth layers. This approximation facilitates the use of connectivity information for segment-based forward warping of the reference layer map, producing a complete virtual view layer map containing no cracks or holes. The warped layer map is used to guide the disocclusions inpainting process of the synthesized texture map. For this purpose, a speed-optimized patch-based inpainting approach is proposed. In contrast to the existing methods, patch similarity function is based on local binary patterns descriptors. Such binary representation allows for efficient processing and comparison of patches, as well as compact storage and reuse of previously calculated binary descriptors. The experimental results demonstrate realtime capability of the proposed method even for CPU-based implementation, while the quality is comparable with other view synthesis approaches.

Keywords

  • image representation, image restoration, image segmentation, image texture, natural scenes, rendering (computer graphics), CPU-based implementation, binary representation, depth layering, local binary pattern descriptor, reference layer map segment-based forward warping, scene geometry, speed-optimized free-viewpoint rendering, speed-optimized patch-based inpainting approach, synthesized texture map disocclusions inpainting process, view-plus-depth 3D representation, Approximation methods, Cameras, Filling, Geometry, Rendering (computer graphics), Three-dimensional displays, Visualization, depth map, depth-imagebased rendering, free-viewpoint rendering, layer-b, view-plus-depth

Publication forum classification

Field of science, Statistics Finland

Downloads statistics

No data available