Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

ACRyLIQ: Leveraging DBpedia for adaptive crowdsourcing in linked data quality assessment

: Hassan, U. ul; Zaveri, A.; Marx, E.; Curry, E.; Lehmann, J.


Blomqvist, Eva:
Knowledge engineering and knowledge management. 20th International Conference, EKAW 2016 : Bologna, Italy, November 19-23, 2016; Proceedings
Cham: Springer International Publishing, 2016 (Lecture Notes in Computer Science 10024)
ISBN: 978-3-319-49003-8 (Print)
ISBN: 978-3-319-49004-5 (Online)
International Conference on Knowledge Engineering and Knowledge Management (EKAW) <20, 2016, Bologna>
Conference Paper
Fraunhofer IAIS ()

Crowdsourcing has emerged as a powerful paradigm for quality assessment and improvement of Linked Data. A major challenge of employing crowdsourcing, for quality assessment in Linked Data, is the cold-start problem: how to estimate the reliability of crowd workers and assign the most reliable workers to tasks? We address this challenge by proposing a novel approach for generating test questions from DBpedia based on the topics associated with quality assessment tasks. These test questions are used to estimate the reliability of the new workers. Subsequently, the tasks are dynamically assigned to reliable workers to help improve the accuracy of collected responses. Our proposed approach, ACRyLIQ, is evaluated using workers hired from Amazon Mechanical Turk, on two real-world Linked Data datasets. We validate the proposed approach in terms of accuracy and compare it against the baseline approach of reliability estimate using gold-standard task. The results demonstrate tha t our proposed approach achieves high accuracy without using gold-standard task.