Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

User Experience of Alexa when controlling music - comparison of face and construct validity of four questionnaires

Benutzererfahrungen mit Alexa bei der Steuerung von Musik - Vergleich von Augenschein- und Konstruktvalidität von vier Fragebögen
: Brüggemeier, Birgit; Breiter, Michael; Kurz, Miriam; Schiwy, Johanna

Preprint urn:nbn:de:0011-n-5932673 (264 KByte PDF)
MD5 Fingerprint: 8698bd7efca08b3e98f4f4fcbfb1d253
Created on: 25.6.2020

Torres, M.I. ; Association for Computing Machinery -ACM-:
2nd Conference on Conversational User Interfaces 2020. Proceedings : Bilbao, Spain, July, 2020
New York: ACM, 2020
ISBN: 978-1-4503-7544-3
Art 1, 9 pp.
Conference on Conversational User Interfaces (CUI) <2, 2020, Online>
Bundesministerium fur Wirtschaft und Energie BMWi (Deutschland)
Conference Paper, Electronic Publication
Fraunhofer IIS ()
user experience; Voice User Interfaces; measuring; SUS; SASSI; SUISQ; AttrakDiff; validity

We evaluate the user experience (UX) of Amazons Alexa when users play and control music. For measuring UX we use established UX metrics (SASSI, SUISQ-R, SUS, AttrakDiff). We investigated face validity by asking users to rate how well they think a questionnaire measures what it is supposed to measure and we assessed construct validity by correlating UX scores of questionnaires with each other. We find a mismatch between face and construct validity of the evaluated questionnaires. Specifically, users feel that SASSI represents their experience better than other questionnaires, however this is not supported by correlations between questionnaires, which suggest that all investigated questionnaires measure UX to a similar extent. Importantly, the fact that face validity and construct validity diverge is not surprising as this has been observed before. Our work adds to existing literature by providing face and construct validity scores of UX questionnaires for interactions with the common speech assistant Alexa.