Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Content-based mood classification for photos and music: A generic multi-modal classification framework and evaluation approach

: Dunker, P.; Nowak, S.; Begau, A.; Lanz, C.


El Saddik, A. ; Association for Computing Machinery -ACM-, Special Interest Group on Multimedia -SIGMM-:
16th ACM International Conference on Multimedia 2008. CD-ROM. Proceedings : Vancouver, British Columbia, Canada, October 26-31, 2008
New York: ACM, 2008
ISBN: 978-1-60558-303-7
ISBN: 978-1-605-58319-8
ISBN: 978-1-605-58320-4
ISBN: 978-1-605-58312-9
ISBN: 978-1-605-58316-7
ISBN: 978-1-605-58314-3
ISBN: 978-1-605-58315-0
ISBN: 978-1-605-58309-9
ISBN: 978-1-605-58313-6
International Conference on Multimedia (MM) <16, 2008, Vancouver>
International Conference on Multimedia Information Retrieval (MIR) <1, 2008, Vancouver>
Conference Paper
Fraunhofer IDMT ()
cross-modal analysis; mood classification

Mood or emotion information are often used search terms or navigation properties within multimedia archives, retrieval systems or multimedia players. Most of these applications engage end-users or experts to tag multimedia objects with mood annotations. Within the scientific community different approaches for content-based music, photo or multimodal mood classification can be found with a wide range of used mood definitions or models and completely different test suites. The purpose of this paper is to review common mood models in order to assess their flexibility, to present a generic multi-modal mood classification framework which uses various audio-visual features and multiple classifiers and to present a novel music and photo mood classification reference set for evaluation. The classification framework is the basis for different applications e.g. automatic media tagging or music slideshow players. The novel reference set can be used for comparison of different algorithms from various research groups. Finally, the results of the introduced framework are presented, discussed and conclusions for future steps are drawn.