Tampere University of Technology

TUTCRIS Research Portal

Fast: Flow-Assisted Shearlet Transform for Densely-Sampled Light Field Reconstruction

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Details

Original languageEnglish
Title of host publication2019 IEEE International Conference on Image Processing (ICIP)
PublisherIEEE
Pages3741-3745
Number of pages5
ISBN (Electronic)978-1-5386-6249-6
ISBN (Print)978-1-5386-6250-2
DOIs
Publication statusPublished - Sep 2019
Publication typeA4 Article in a conference publication
EventIEEE International Conference on Image Processing -
Duration: 1 Jan 1900 → …

Publication series

NameIEEE International Conference on Image Processing
ISSN (Print)1522-4880
ISSN (Electronic)2381-8549

Conference

ConferenceIEEE International Conference on Image Processing
Period1/01/00 → …

Abstract

Shearlet Transform (ST) is one of the most effective methods for Densely-Sampled Light Field (DSLF) reconstruction from a Sparsely-Sampled Light Field (SSLF). However, ST requires a precise disparity estimation of the SSLF. To this end, in this paper a state-of-the-art optical flow method, i.e. PWC-Net, is employed to estimate bidirectional disparity maps between neighboring views in the SSLF. Moreover, to take full advantage of optical flow and ST for DSLF reconstruction, a novel learning-based method, referred to as Flow-Assisted Shearlet Transform (FAST), is proposed in this paper. Specifically, FAST consists of two deep convolutional neural networks, i.e. disparity refinement network and view synthesis network, which fully leverage the disparity information to synthesize novel views via warping and blending and to improve the novel view synthesis performance of ST. Experimental results demonstrate the superiority of the proposed FAST method over the other state-of-the-art DSLF reconstruction methods on nine challenging real-world SSLF sub-datasets with large disparity ranges (up to 26 pixels).

Keywords

  • Image reconstruction, Transforms, Optical imaging, Cameras, Adaptive optics, Training, Light fields, Densely-Sampled Light Field Reconstruction, Parallax View Generation, Novel View Synthesis, Shearlet Transform, Flow-Assisted Shearlet Transform

Publication forum classification

Field of science, Statistics Finland