Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

THESEUS meets ImageCLEF: Combining evaluation strategies for a new visual concept detection task 2009

: Nowak, S.; Dunker, P.; Paduschek, R.


Peters, C.:
Evaluating systems for multilingual and multimodal information access. Revised selected papers : 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008
Berlin: Springer, 2009 (Lecture Notes in Computer Science (LNCS) 5706)
ISBN: 3-642-04446-8
ISBN: 978-3-642-04446-5
Workshop of the Cross Language Evaluation Forum (CLEF) <9, 2008, Århus>
Conference Paper
Fraunhofer IDMT ()

Automatic methods for archiving, indexing and retrieving multimedia content become more and more important through the steadily increasing amount of digital data in the web and at home. THESEUS, a German research program, focuses on developing sophisticated algorithms and evaluation strategies for the automated processing of digital data. In this paper we present how evaluation is performed in THESEUS and introduce a generic framework for the evaluation of various video and image analysis algorithms. Besides, evaluation campaigns like the Cross Evaluation Language Forum (CLEF) and subprojects like ImageCLEF deal with the evaluation of such algorithms and provide an objective comparison of their performance. We relate the THESEUS tasks to the work done in ImageCLEF and propose a new task for ImageCLEF 2009.
This work has been supported by the German THESEUS program.