Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Retrieval of Song Lyrics from Sung Queries

: Kruspe, A.M.; Goto, M.


Institute of Electrical and Electronics Engineers -IEEE-; IEEE Signal Processing Society:
IEEE International Conference on Acoustics, Speech, and Signal Processing 2018. Proceedings : April 15-20, 2018, Calgary Telus Convention Center, Calgary, Alberty, Canada
Piscataway, NJ: IEEE, 2018
ISBN: 978-1-5386-4658-8
ISBN: 978-1-5386-4657-1
ISBN: 978-1-5386-4659-5
International Conference on Acoustics, Speech, and Signal Processing (ICASSP) <2018, Calgary>
Fraunhofer IDMT ()

Retrieving the lyrics of a sung recording from a database of text documents is a research topic that has not received much attention so far. Such a retrieval system has many practical applications, e.g. for karaoke applications or for indexing large song databases by their lyric content. We present a new method for lyrics retrieval. An acoustic model trained on singing is used to obtain phoneme probabilities from sung queries, which are then mapped to phoneme sequences. These are compared against lines of textual lyrics in a large corpus in order to retrieve the best-matching song. The approach is tested on three sung datasets. Lyrics are retrieved from a set of 300 possible songs (12,000 lines of lyrics). The results are highly encouraging and could be used further to perform automatic lyrics alignment and keyword spotting for large databases of songs, or for retrieving lyrics from the internet.