Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

A framework to conduct and report on empirical user studies in semantic web contexts

: Pesquita, C.; Ivanova, V.; Lohmann, S.; Lambrix, P.


Faron Zucker, C.:
Knowledge Engineering and Knowledge Management. 21st International Conference, EKAW 2018. Proceedings : Nancy, France, November 12-16, 2018
Cham: Springer International Publishing, 2018 (Lecture Notes in Computer Science 11313)
ISBN: 978-3-030-03666-9 (Print)
ISBN: 978-3-030-03667-6 (Online)
ISBN: 978-3-030-03668-3
International Conference on Knowledge Engineering and Knowledge Management (EKAW) <21, 2018, Nancy>
Fraunhofer IAIS ()

Semantic Web technologies are being applied to increasingly diverse areas where user involvement is crucial. While a number of user interfaces for Semantic Web systems have become available in the past years, their evaluation and reporting often still suffer from weaknesses. Empirical evaluations are essential to compare different approaches, demonstrate their benefits and reveal their drawbacks, and thus to facilitate further adoption of Semantic Web technologies. In this paper, we review empirical user studies of user interfaces, visualizations and interaction techniques recently published at relevant Semantic Web venues, assessing both the user studies themselves and their reporting. We then chart the design space of available methods for user studies in Semantic Web contexts. Finally, we propose a framework for their comprehensive reporting, taking into consideration user expertise, experimental setup, task design, experimental procedures and results analysis.