• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Konferenzschrift
  4. Towards User-Aware VR Learning Environments: Combining Brain-Computer Interfaces with Virtual Reality for Mental State Decoding
 
  • Details
  • Full
Options
2023
Conference Paper
Title

Towards User-Aware VR Learning Environments: Combining Brain-Computer Interfaces with Virtual Reality for Mental State Decoding

Abstract
User-aware adaptive systems can greatly benefit from brain-computer interface (BCI) technologies. BCIs allow continuous monitoring of users' mental states and tailoring of the system to their individual skills and needs. We conducted a feasibility study integrating a BCI using functional near-infrared spectroscopy (fNIRS) into a virtual reality (VR) environment for realistic industrial learning scenarios. Using a fNIRS-based BCI allowed us to a) identify learning progress of individuals based on their working memory load across multiple learning sessions and b) investigate the underlying brain patterns. Our results showed a non-linear relationship between task difficulty and brain responses in the prefrontal cortex (PFC). Finally, we were able to draw four major conclusions regarding architecture components and vital research perspectives, to progress towards a vision of user-aware adaptive system design.
Author(s)
Lingelbach, Katharina  
Fraunhofer-Institut für Arbeitswirtschaft und Organisation IAO  
Diers, Daniel  
Univ. Stuttgart, Institut für Arbeitswissenschaft und Technologiemanagement
Vukelic, Mathias  
Fraunhofer-Institut für Arbeitswirtschaft und Organisation IAO  
Mainwork
CHI 2023, Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems  
Project(s)
KI-Fortschrittszentrum »Lernende Systeme und Kognitive Robotik«  
Funder
Baden-Württemberg, Ministerium für Wirtschaft, Arbeit und Wohnungsbau  
Conference
Conference on Human Factors in Computing Systems 2023  
DOI
10.1145/3544549.3585716
Language
English
Fraunhofer-Institut für Arbeitswirtschaft und Organisation IAO  
Keyword(s)
  • Brain-Computer Interface (BCI)

  • Learning

  • Mental State Monitoring

  • Working Memory

  • Workload

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024