Fraunhofer-Gesellschaft

Publica

Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

User Experience of Alexa when controlling music - comparison of face and construct validity of four questionnaires

Paper presented at 2nd Conference on Conversational User Interfaces, CUI 2020, July 22-24, 2020, Bilbao, Spain
Benutzererfahrungen mit Alexa bei der Steuerung von Musik - Vergleich von Augenschein- und Konstruktvalidität von vier Fragebögen
 
: Brüggemeier, Birgit; Breiter, Michael; Kurz, Miriam; Schiwy, Johanna

:
Preprint urn:nbn:de:0011-n-5932673 (264 KByte PDF)
MD5 Fingerprint: 8698bd7efca08b3e98f4f4fcbfb1d253
Erstellt am: 25.6.2020


2020, 13 S.
Conference on Conversational User Interfaces (CUI) <2, 2020, Bilbao>
Bundesministerium fur Wirtschaft und Energie BMWi (Deutschland)
01MK20011A; SPEAKER
Englisch
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IIS ()
user experience; Voice User Interfaces; measuring; SUS; SASSI; SUISQ; AttrakDiff; validity

Abstract
We evaluate the user experience (UX) of Amazons Alexa when users play and control music. For measuring UX we use established UX metrics (SASSI, SUISQ-R, SUS, AttrakDiff). We investigated face validity by asking users to rate how well they think a questionnaire measures what it is supposed to measure and we assessed construct validity by correlating UX scores of questionnaires with each other. We find a mismatch between face and construct validity of the evaluated questionnaires. Specifically, users feel that SASSI represents their experience better than other questionnaires, however this is not supported by correlations between questionnaires, which suggest that all investigated questionnaires measure UX to a similar extent. Importantly, the fact that face validity and construct validity diverge is not surprising as this has been observed before. Our work adds to existing literature by providing face and construct validity scores of UX questionnaires for interactions with the common speech assistant Alexa.

: http://publica.fraunhofer.de/dokumente/N-593267.html