Nowak, S.S.Nowak2022-03-072022-03-072011https://publica.fraunhofer.de/handle/publica/2792361. Introduction 1 1.1. Motivation 1 1.2. Research objectives 2 1.3. Contributions 3 1.4. Outline o f the thesis 5 1.5. Publications 6 1. Context and related work 9 2. Visual Information Retrieval and annotation 13 2.1. Introduction t o image annotation 13 2.2. The basic image annotation and evaluation pipeline 15 2.2.1. Descriptors 16 2.2.2. Classifier 17 2.2.3. Fusion techniques and post-processing 18 2.3. Explicit semantics in Visual Information Retrieval 19 2.4. Related work on multi-label image annotation 20 2.5. Summary 22 3. Evaluation of visual Information Retrieval and annotation 23 3.1. History o f experimental evaluation 23 3.2. Test collections for VIR 25 3.2.1. Requirements 25 3.2.2. Visual concepts 26 3.2.3. Relevance assessment 27 3.2.4. Databases 29 3.3. Evaluation measures 29 3.3.1. General notations 30 3.3.2. Concept-based evaluation measures for label set predictions 3 1 3.3.3. Concept-based evaluation measures for ranked assignments 32 3.3.4. Example-based evaluation measures for label set predictions 33 3.3.5. Example-based evaluation measures for ranked assignments 34 3.3.6. Significance tests 35 3.4. Benchmarks for multimedia retrieval 35 3.5. Summary 37en621004006020doctoral thesis