Fraunhofer-Gesellschaft

Publica

Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Towards evaluating multiple predominant melody annotations in jazz recordings

 
: Balke, Stefan; Driedger, Jonathan; Abeßer, Jakob; Dittmar, Christian; Müller, Meinard

:
Fulltext (PDF; )

Mandel, M.I. ; International Society for Music Information Retrieval -ISMIR-:
17th International Society for Music Information Retrieval Conference, ISMIR 2016. Proceedings : New York City, United States, August 7-11, 2016
New York/NY, 2016
ISBN: 978-0-692-75506-8
pp.246-252
International Society for Music Information Retrieval (ISMIR Conference) <17, 2016, New York/NY)
English
Conference Paper, Electronic Publication
Fraunhofer IDMT ()

Abstract
Melody estimation algorithms are typically evaluated by separately assessing the task of voice activity detection and fundamental frequency estimation. For both subtasks, computed results are typically compared to a single human reference annotation. This is problematic since different human experts may differ in how they specify a predominant melody, thus leading to a pool of equally valid reference annotations. In this paper, we address the problem of evaluating melody extraction algorithms within a jazz music scenario. Using four human and two automatically computed annotations, we discuss the limitations of standard evaluation measures and introduce an adaptation of Fleiss’ kappa that can better account for multiple reference annotations. Our experiments not only highlight the behavior of the different evaluation measures, but also give deeper insights into the melody extraction task.

: http://publica.fraunhofer.de/documents/N-435939.html