TUTCRIS - Tampereen teknillinen yliopisto

TUTCRIS

Datasets and Evaluation

Tutkimustuotosvertaisarvioitu

Yksityiskohdat

AlkuperäiskieliEnglanti
OtsikkoComputational Analysis of Sound Scenes and Events
ToimittajatTuomas Virtanen, Mark D. Plumbley, Dan Ellis
JulkaisupaikkaCham
KustantajaSpringer
Sivut147-179
Sivumäärä33
ISBN (elektroninen)978-3-319-63450-0
ISBN (painettu)978-3-319-63449-4
DOI - pysyväislinkit
TilaJulkaistu - 2018
OKM-julkaisutyyppiA3 Kirjan tai muun kokoomateoksen osa

Tiivistelmä

Developing computational systems requires methods for evaluating their performance to guide development and compare alternate approaches. A reliable evaluation procedure for a classification or recognition system will involve a standard dataset of example input data along with the intended target output, and well-defined metrics to compare the systems' outputs with this ground truth. This chapter examines the important factors in the design and construction of evaluation datasets and goes through the metrics commonly used in system evaluation, comparing their properties. We include a survey of currently available datasets for environmental sound scene and event recognition and conclude with advice for designing evaluation protocols.

Julkaisufoorumi-taso