Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB

Filters

1
Reset filters

Settings
Now showing 1 - 7 of 7
  • Publication
    Generating Proactive Suggestions based on the Context: User Evaluation of Large Language Model Outputs for In-Vehicle Voice Assistants
    ( 2024)
    Mathis, Lesley-Ann
    ;
    Günes, Can
    ;
    Entz, Kathleen
    ;
    Lerch, David
    ;
    Diederichs, Frederik
    ;
    Widlroither, Harald
    Large Language Models (LLMs) have recently been explored for a variety of tasks, most prominently for dialogue-based interactions with users. The future in-car voice assistant (VA) is envisioned as a proactive companion making suggestions to the user during the ride. We investigate the use of selected LLMs to generate proactive suggestions for a VA given different context situations by using a basic prompt design. An online study with users was conducted to evaluate the generated suggestions. We demonstrate the feasibility of generating context-based proactive suggestions with different off-the-shelf LLMs. Results of the user survey show that suggestions generated by the LLMs GPT4.0 and Bison received an overall positive evaluation regarding the user experience for response quality and response behavior over different context situations. This work can serve as a starting point to implement proactive interaction for VA with LLMs based on the recognized context situation in the car.
  • Publication
    Activities that Correlate with Motion Sickness in Driving Cars – An International Online Survey
    ( 2024)
    Diederichs, Frederik
    ;
    Herrmanns, Amina
    ;
    Lerch, David
    ;
    Zhong, Zeyun
    ;
    Daniela Piechnik
    ;
    Mathis, Lesley-Ann
    ;
    Xian, Boyu
    ;
    Vaupel, Nicklas Jakob Elia
    ;
    Vijayakumar, Ajona
    ;
    Cabaroglu, Canmert
    ;
    Rausch, Jessica
    Up to 2 out of 3 passengers suffer from motion sickness, caused by non-driving related activities. Occupant monitoring systems detect such activities via cameras in the vehicle interior and hence can be used to warn passengers or to assist them. An international online survey in Germany, USA, China, India, Turkey and Mexico was conducted in order to identify activities that correlate with motion sickness. The results identify reading, using a device, watching a movie and turning in the seat to be the most relevant activities for occupant monitoring systems to detect and hence for motion sickness assistance systems to address.
  • Publication
    Watch Out Car, He’s Drunk! How Passengers of Vehicles Perceive Risky Crossing Situations Based on Situational Parameters
    ( 2022)
    Bopp-Bertenbreiter, Anja Valeria
    ;
    Bähr, Sabina
    ;
    Albrecht, Simon
    ;
    Freudenmann, Thomas
    ;
    El-Haji, Mohanad
    ;
    Martin, Manuel
    ;
    Anh, Natalya
    ;
    Rauber, Stephan
    Automated vehicles promise enhanced road safety for their passengers, other vehicles, and vulnerable road user (VRU). To do so, automated vehicles must be designed to reliably detect potentially critical situations. Humans can detect such situations using context cues. Context cues allow humans drivers to anticipate unexpected crossings, e.g., of intoxicated night owls in a street full of bars and clubs on a Friday night and, consequently, to decelerate in advance to prevent critical incidents. We used the “Incident Detector” to identify possible context cues that human drivers might use to assess the criticality of traffic situations in which a car encounters a VRU. Investigated potential predictors include VRUs’ mode of transport, VRUs’ speed, VRUs’ age, VRUs’ predictability of behavior, and visibility obstruction of VRUs by parked cars. In an online study, 133 participants watched videos of potentially risky crossing situations with VRUs from the driver’s point of view. In addition, the participants’ age, gender, status of driver’s license, sense of presence, and driving style were queried. The results show that perceived risk correlates significantly with age, speed, and predictability of VRUs behavior, as well as with visibility obstruction and participants’ age. We will use the results to include detected influence factors on perceived subjective risk into virtual test scenarios. Automated vehicles will need to pass these virtual test scenarios to be deemed acceptable regarding objective and subjective risk. These test scenarios can support road safety and thus, greater acceptance of automated vehicles.
  • Publication
    Artificial Intelligence for Adaptive, Responsive, and Level-Compliant Interaction in the Vehicle of the Future (KARLI)
    ( 2022)
    Diederichs, Frederik
    ;
    Wannemacher, Christoph
    ;
    Faller, Fabian
    ;
    Schmidt, Eike
    ;
    Engelhardt, Doreen
    ;
    Mikolajewski, Martin
    ;
    Rittger, Lena
    ;
    Voit, Michael
    ;
    Widlroither, Harald
    ;
    Martin, Manuel
    ;
    Hashemi, Vahid
    ;
    Sahakyan, Manya
    ;
    Romanelli, Massimo
    ;
    Kiefer, Bernd
    ;
    Fäßler, Victor
    ;
    Rößler, Tobias
    ;
    Großerüschkamp, Marc
    ;
    Kurbos, Andreas
    ;
    Bottesch, Miriam
    ;
    Immoor, Pia
    ;
    Engeln, Arnd
    ;
    Fleischmann, Marlis
    ;
    Schweiker, Miriam
    ;
    Pagenkopf, Anne
    ;
    Daniela Piechnik
    ;
    Mathis, Lesley-Ann
    The KARLI project consortium investigates and develops monitoring systems for drivers and other occupants with new artificial intelligence approaches, based on high quality labeled data that is collected in real vehicles. The project’s target applications are integrated in vehicles that enable various levels of automation and transitions of control. Level-compliant occupant behavior is assessed with AI algorithms and modulated with responsive and adaptive human machine interface (HMI) solutions. The project also targets the prediction and prevention of motion sickness in order to improve the user experience, enabling productivity and maintaining an adequate driver state. The user-centered approach is represented by defining five KARLI User Roles which specify the driving related behavior requirements for all levels of automation. The project results will be evaluated at the end of the project. The KARLI applications will be evaluated regarding user experience benefits and AI performance measures. The KARLI project is approaching two main challenges that are ambitious and have a high potential: First, raising and investigating the potential of AI for driver monitoring and driver-vehicle interaction, and second, accelerating the transfer from research to series production applications.
  • Publication
    Improving Driver Performance and Experience in Assisted and Automated Driving with Visual Cues in the Steering Wheel
    ( 2022)
    Diederichs, Frederik
    ;
    Muthumani, Arun
    ;
    Feierle, Alexander
    ;
    Galle, Melanie
    ;
    Mathis, Lesley-Ann
    ;
    Bopp-Bertenbreiter, Anja Valeria
    ;
    Widlroither, Harald
    ;
    Bengler, Klaus
    In automated driving it is important to ensure drivers’ awareness of the currently active level of automation and to support transitions between those levels. This is possible with a suitable human-machine interface (HMI). In this driving simulator study, two visual HMI concepts (Concept A and B ) were compared with a baseline for informing drivers about three modes: manual driving, assisted driving, and automated driving. The HMIs, consisting of LED strips on the steering wheel that differed in luminance, color, and pattern, provided continuous information about the active mode and announced transitions. The assisted mode was conveyed in Concept A using a combination of amber and blue LEDs, while in Concept B only amber LEDs were used. During automated driving Concept A displayed blue LEDs and Concept B, turquoise. Both concepts were compared to a baseline HMI, with no LEDs. Thirty-eight drivers with driving licence were trained and participated. Objective measures (hands-on-wheel time, takeover time, and visual attention) are reported. Self-reported measures (mode awareness, trust, user experience, and user acceptance) from a previous publication are briefly repeated in this context (Muthumani et al.). Concept A showed 200 ms faster hands-on-wheel times than the baseline, while in Concept B several outliers were observed that prevented significance. The visual HMIs with LEDs did not influence the eyes-on-road time in any of the automation levels. Participants preferred Concept B, with more prominent differentiation between the automation levels, over Concept A.
  • Publication
    Disruptive Innovation in Manufacturing Engineering towards the 4th Industrial Revolution
    (Elsevier, 2014)
    The CIRP sponsored DET 2014 conference focusses on the employment of modern ICT-technologies and tools for the modeling, simulation, optimization, advanced control and monitoring, real-time visualization of products, factories and manufacturing processes. The addressed areas cover all phases of product, factory and manufacturing processes life cycle starting with product design and development, engineering of factories, machines, equipment and technical processes, commissioning and rump-up, followed by manufacturing operations, maintenance and facility management up to products recycling/re-use, factory overhaul and environmentally friendly dismantling.