Tampere University of Technology

TUTCRIS Research Portal

No-reference visual quality assessment for image inpainting

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Details

Original languageEnglish
Title of host publicationImage Processing: Algorithms and Systems XIII
PublisherSPIE
ISBN (Print)9781628414899
DOIs
Publication statusPublished - 2015
Publication typeA4 Article in a conference publication
EventIS&T/SPIE Electronic Imaging / Image Processing: Algorithms and Systems -
Duration: 1 Jan 1900 → …

Publication series

NameSPIE Conference Proceedings
Volume9399

Conference

ConferenceIS&T/SPIE Electronic Imaging / Image Processing: Algorithms and Systems
Period1/01/00 → …

Abstract

Inpainting has received a lot of attention in recent years and quality assessment is an important task to evaluate different image reconstruction approaches. In many cases inpainting methods introduce a blur in sharp transitions in image and image contours in the recovery of large areas with missing pixels and often fail to recover curvy boundary edges. Quantitative metrics of inpainting results currently do not exist and researchers use human comparisons to evaluate their methodologies and techniques. Most objective quality assessment methods rely on a reference image, which is often not available in inpainting applications. Usually researchers use subjective quality assessment by human observers. It is difficult and time consuming procedure. This paper focuses on a machine learning approach for no-reference visual quality assessment for image inpainting based on the human visual property. Our method is based on observation that Local Binary Patterns well describe local structural information of the image. We use a support vector regression learned on assessed by human images to predict perceived quality of inpainted images. We demonstrate how our predicted quality value correlates with qualitative opinion in a human observer study. Results are shown on a human-scored dataset for different inpainting methods.

Keywords

  • Inpainting, Machine learning, Metric, Quality assessment, SVR, Visual salience

Publication forum classification

Field of science, Statistics Finland