Tampere University of Technology

TUTCRIS Research Portal

Depth Assisted Composition of Synthetic and Real 3D Scenes

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review


Original languageEnglish
Title of host publicationProceedings of the IS&T International Symposium on Electronic Imaging
Publication statusPublished - Feb 2016
Publication typeA4 Article in a conference publication
EventIS&T International Symposium on Electronic Imaging -
Duration: 1 Jan 2000 → …

Publication series

ISSN (Electronic)2470-1173


ConferenceIS&T International Symposium on Electronic Imaging
Period1/01/00 → …


In media production, previsualization is an important step. It allows the director and the production crew to see an estimate of the final product during the filmmaking process. This work focuses in a previsualization system for composite shots, which involves real and virtual content. The system visualizes a correct perspective view of how the real objects in front of the camera operator look placed in a virtual space. The aim is to simplify the workflow, reduce production time and allow more direct control of the end result. The real scene is shot with a time-of-flight depth camera, whose pose is tracked using a motion capture system. Depth-based segmentation is applied to remove the background and content outside the desired volume, the geometry is aligned with a stream from an RGB color camera and a dynamic point cloud of the remaining real scene contents is created. The virtual objects are then also transformed into the coordinate space of the tracked camera, and the resulting composite view is rendered accordingly. The prototype camera system is implemented as a self-contained unit with local processing, and it runs at 15 fps and produces a 1024x768 image.

Publication forum classification

Field of science, Statistics Finland