Tampere University of Technology

TUTCRIS Research Portal

Modeling lens optics and rendering virtual views from fisheye imagery

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review


Original languageEnglish
Title of host publicationElectronic Imaging, Image Processing: Algorithms and Systems XVII
Publication statusPublished - 13 Jan 2019
Publication typeA4 Article in a conference publication
EventIS&T International Symposium on Electronic Imaging -
Duration: 13 Jan 201917 Jan 2019

Publication series

NameIS&T International Symposium on Electronic Imaging
ISSN (Electronic)2470-1173


ConferenceIS&T International Symposium on Electronic Imaging


Production of high-quality virtual reality content from real sensed data is a challenging task due to several factors such as calibration of multiple cameras and rendering of virtual views. In this paper, we present a pipeline that maximizes the performance of virtual view rendering from an imagery captured by a camera equipped with fisheye lens optics. While such optics offer a wide field-of-view, it also introduces specific distortions. These have to be taken into account while rendering virtual views for a target application (e.g., head-mounted displays). We integrate a generic camera model into a fast rendering pipeline where we can tune intrinsic and extrinsic camera parameters along with resolution to meet the device or user requirements. We specifically target CPU-based implementation and quality in par with GPU-based rendering approaches. Using the adopted generic camera model, we numerically tabulate the required backward projection mapping and store it in a look-up table. This approach offers a tradeoff between memory and computational complexity in terms of operations for calculating the mapping values. Finally, we complement our method with an interpolator, which handles occlusions efficiently. Experimental results demonstrate the viability, robustness and accuracy of the proposed pipeline.

Publication forum classification

Field of science, Statistics Finland