Tampere University of Technology

TUTCRIS Research Portal

Subjective evaluation of Super Multi-View compressed contents on high-end light-field 3D displays

Research output: Contribution to journalArticleScientificpeer-review

Standard

Subjective evaluation of Super Multi-View compressed contents on high-end light-field 3D displays. / Dricot, Antoine; Jung, Joel; Cagnazzo, Marco; Pesquet, Béatrice; Dufaux, Frédéric; Kovács, Péter; Adhikarla, Vamsi Kiran.

In: Signal Processing: Image Communication, Vol. 39, No. Part B, 2015, p. 369–385.

Research output: Contribution to journalArticleScientificpeer-review

Harvard

Dricot, A, Jung, J, Cagnazzo, M, Pesquet, B, Dufaux, F, Kovács, P & Adhikarla, VK 2015, 'Subjective evaluation of Super Multi-View compressed contents on high-end light-field 3D displays', Signal Processing: Image Communication, vol. 39, no. Part B, pp. 369–385. https://doi.org/10.1016/j.image.2015.04.012

APA

Dricot, A., Jung, J., Cagnazzo, M., Pesquet, B., Dufaux, F., Kovács, P., & Adhikarla, V. K. (2015). Subjective evaluation of Super Multi-View compressed contents on high-end light-field 3D displays. Signal Processing: Image Communication, 39(Part B), 369–385. https://doi.org/10.1016/j.image.2015.04.012

Vancouver

Dricot A, Jung J, Cagnazzo M, Pesquet B, Dufaux F, Kovács P et al. Subjective evaluation of Super Multi-View compressed contents on high-end light-field 3D displays. Signal Processing: Image Communication. 2015;39(Part B):369–385. https://doi.org/10.1016/j.image.2015.04.012

Author

Dricot, Antoine ; Jung, Joel ; Cagnazzo, Marco ; Pesquet, Béatrice ; Dufaux, Frédéric ; Kovács, Péter ; Adhikarla, Vamsi Kiran. / Subjective evaluation of Super Multi-View compressed contents on high-end light-field 3D displays. In: Signal Processing: Image Communication. 2015 ; Vol. 39, No. Part B. pp. 369–385.

Bibtex - Download

@article{8d6527601f9740bba69bd89e56757c7c,
title = "Subjective evaluation of Super Multi-View compressed contents on high-end light-field 3D displays",
abstract = "Super Multi-View (SMV) video content is composed of tens or hundreds of views that provide a light-field representation of a scene. This representation allows a glass-free visualization and eliminates many causes of discomfort existing in current available 3D video technologies. Efficient video compression of SMV content is a key factor for enabling future 3D video services. This paper first compares several coding configurations for SMV content and several inter-view prediction structures are also tested and compared. The experiments mainly suggest that large differences in coding efficiency can be observed from one configuration to another. Several ratios for the number of coded and synthesized views are compared, both objectively and subjectively. It is reported that view synthesis significantly affects the coding scheme. The amount of views to skip highly depends on the sequence and on the quality of the associated depth maps. Reported ranges of bitrates required to obtain a good quality for the tested SMV content are realistic and coherent with future 4. K/8. K needs. The reliability of the PSNR metric for SMV content is also studied. Objective and subjective results show that PSNR is able to reflect increase or decrease in subjective quality even in the presence of synthesized views. However, depending on the ratio of coded and synthesized views, the order of magnitude of the effective quality variation is biased by PSNR. Results indicate that PSNR is less tolerant to view synthesis artifacts than human viewers. Finally, preliminary observations are initiated. First, the light-field conversion step does not seem to alter the objective results for compression. Secondly, the motion parallax does not seem to be impacted by specific compression artifacts. The perception of the motion parallax is only altered by variations of the typical compression artifacts along the viewing angle, in cases where the subjective image quality is already low. To the best of our knowledge, this paper is the first to carry out subjective experiments and to report results of SMV compression for light-field 3D displays. It provides first results showing that improvement of compression efficiency is required, as well as depth estimation and view synthesis algorithms improvement, but that the use of SMV appears realistic according to next generation compression technology requirements.",
keywords = "3D, Light-field, Subjective evaluation, Super Multi-View, Video coding, Video compression",
author = "Antoine Dricot and Joel Jung and Marco Cagnazzo and B{\'e}atrice Pesquet and Fr{\'e}d{\'e}ric Dufaux and P{\'e}ter Kov{\'a}cs and Adhikarla, {Vamsi Kiran}",
year = "2015",
doi = "10.1016/j.image.2015.04.012",
language = "English",
volume = "39",
pages = "369–385",
journal = "Signal Processing: Image Communication",
issn = "0923-5965",
publisher = "Elsevier",
number = "Part B",

}

RIS (suitable for import to EndNote) - Download

TY - JOUR

T1 - Subjective evaluation of Super Multi-View compressed contents on high-end light-field 3D displays

AU - Dricot, Antoine

AU - Jung, Joel

AU - Cagnazzo, Marco

AU - Pesquet, Béatrice

AU - Dufaux, Frédéric

AU - Kovács, Péter

AU - Adhikarla, Vamsi Kiran

PY - 2015

Y1 - 2015

N2 - Super Multi-View (SMV) video content is composed of tens or hundreds of views that provide a light-field representation of a scene. This representation allows a glass-free visualization and eliminates many causes of discomfort existing in current available 3D video technologies. Efficient video compression of SMV content is a key factor for enabling future 3D video services. This paper first compares several coding configurations for SMV content and several inter-view prediction structures are also tested and compared. The experiments mainly suggest that large differences in coding efficiency can be observed from one configuration to another. Several ratios for the number of coded and synthesized views are compared, both objectively and subjectively. It is reported that view synthesis significantly affects the coding scheme. The amount of views to skip highly depends on the sequence and on the quality of the associated depth maps. Reported ranges of bitrates required to obtain a good quality for the tested SMV content are realistic and coherent with future 4. K/8. K needs. The reliability of the PSNR metric for SMV content is also studied. Objective and subjective results show that PSNR is able to reflect increase or decrease in subjective quality even in the presence of synthesized views. However, depending on the ratio of coded and synthesized views, the order of magnitude of the effective quality variation is biased by PSNR. Results indicate that PSNR is less tolerant to view synthesis artifacts than human viewers. Finally, preliminary observations are initiated. First, the light-field conversion step does not seem to alter the objective results for compression. Secondly, the motion parallax does not seem to be impacted by specific compression artifacts. The perception of the motion parallax is only altered by variations of the typical compression artifacts along the viewing angle, in cases where the subjective image quality is already low. To the best of our knowledge, this paper is the first to carry out subjective experiments and to report results of SMV compression for light-field 3D displays. It provides first results showing that improvement of compression efficiency is required, as well as depth estimation and view synthesis algorithms improvement, but that the use of SMV appears realistic according to next generation compression technology requirements.

AB - Super Multi-View (SMV) video content is composed of tens or hundreds of views that provide a light-field representation of a scene. This representation allows a glass-free visualization and eliminates many causes of discomfort existing in current available 3D video technologies. Efficient video compression of SMV content is a key factor for enabling future 3D video services. This paper first compares several coding configurations for SMV content and several inter-view prediction structures are also tested and compared. The experiments mainly suggest that large differences in coding efficiency can be observed from one configuration to another. Several ratios for the number of coded and synthesized views are compared, both objectively and subjectively. It is reported that view synthesis significantly affects the coding scheme. The amount of views to skip highly depends on the sequence and on the quality of the associated depth maps. Reported ranges of bitrates required to obtain a good quality for the tested SMV content are realistic and coherent with future 4. K/8. K needs. The reliability of the PSNR metric for SMV content is also studied. Objective and subjective results show that PSNR is able to reflect increase or decrease in subjective quality even in the presence of synthesized views. However, depending on the ratio of coded and synthesized views, the order of magnitude of the effective quality variation is biased by PSNR. Results indicate that PSNR is less tolerant to view synthesis artifacts than human viewers. Finally, preliminary observations are initiated. First, the light-field conversion step does not seem to alter the objective results for compression. Secondly, the motion parallax does not seem to be impacted by specific compression artifacts. The perception of the motion parallax is only altered by variations of the typical compression artifacts along the viewing angle, in cases where the subjective image quality is already low. To the best of our knowledge, this paper is the first to carry out subjective experiments and to report results of SMV compression for light-field 3D displays. It provides first results showing that improvement of compression efficiency is required, as well as depth estimation and view synthesis algorithms improvement, but that the use of SMV appears realistic according to next generation compression technology requirements.

KW - 3D

KW - Light-field

KW - Subjective evaluation

KW - Super Multi-View

KW - Video coding

KW - Video compression

U2 - 10.1016/j.image.2015.04.012

DO - 10.1016/j.image.2015.04.012

M3 - Article

VL - 39

SP - 369

EP - 385

JO - Signal Processing: Image Communication

JF - Signal Processing: Image Communication

SN - 0923-5965

IS - Part B

ER -