Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Exploring design opportunities for intelligent worker assistance: A new approach using projetion-based AR and a novel hand-tracking algorithm

: Büttner, Sebastian; Sand, Oliver; Röcker, Carsten


Braun, Andreas (Ed.); Wichert, Reiner (Ed.); Gomez, Antonio Maña (Ed.):
Ambient Intelligence. 13th European Conference, AmI 2017 : Malaga, Spain, April 26-28, 2017, Proceedings
Cham: Springer International Publishing, 2017 (Lecture Notes in Computer Science 10217)
ISBN: 978-3-319-56996-3 (Print)
ISBN: 978-3-319-56997-0 (Online)
ISBN: 3-319-56996-1
DOI: 10.1007/978-3-319-56997-0
European Conference on Ambient Intelligence (AmI) <13, 2017, Malaga>
Conference Paper
Fraunhofer IOSB ()

This paper presents a prototype of an intelligent assistive system for workers in stationary manual assembly using projection-based augmented reality (AR) and intelligent hand tracking. By using depth cameras, the system can track the hands of the user and makes the user aware of wrong picking actions or errors in the assembly process. The system automatically adapts the digital projection-based overlay according to the current work situation. The main research contribution of our work is the presentation of a novel hand-tracking algorithm. In addition, we present the results of an user study of the system that shows the challenges and opportunities of our system and the hand-tracking algorithm in particular. We assume that our results will inform the future design of assistive systems in manual assembly.