Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Towards cross-modal search and synchronization of music and video streams

: Großmann, Holger; Kruspe, Anna; Abeßer, Jakob; Lukashevich, Hanna

Volltext (PDF; )

International Congress on Computer Science: Information Systems and Technology. CSIST 2012
Minsk, 2012
ISBN: 978-985-518-564-3
International Congress on Computer Science, Information Systems and Technology (CSIST) <2012, Minsk>
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IDMT ()
cross-modal analysis; music synchronization

With music markets shifting, the commercial use of music in video productions for film, TV or advertisement worldwide grows increasingly important. Our novel research project «SyncGlobal» addresses this global music licensing opportunity by developing adequate time-aware search technologies to efficiently handle sync licensing requests. The goal is to find the best acoustic or semantic matches to any video sequence from large-scale intercultural music catalogs with minimum human efforts involved. In this paper we outline conceptual issues and technology requirements derived from different application scenarios. We briefly introduce music and video segmentation, cross-modal semantic mapping strategies and time-aware music search techniques based on audio signal analysis.