Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Teaching by Demonstrating - How Smart Assistive Systems can Learn from Users

: Büttner, Sebastian; Peda, Andreas; Heinz, Mario; Röcker, Carsten


Streitz, N.:
Distributed, Ambient and Pervasive Interactions. 8th International Conference, DAPI 2020. Proceedings : Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19-24, 2020, held virtually
Cham: Springer Nature, 2020 (Lecture Notes in Computer Science 12203)
ISBN: 978-3-030-50343-7 (Print)
ISBN: 978-3-030-50344-4 (Online)
ISBN: 978-3-030-50345-1
International Conference on Distributed, Ambient and Pervasive Interactions (DAPI) <8, 2020, Online>
International Conference on Human-Computer Interaction (HCI International) <22, 2020, Online>
Conference Paper
Fraunhofer IOSB ()

Projection-based assitive systems that guide users through assembly work are on their way to industrial application. Previous research work investigated how people can be supported with such systems. However, there has been little work on the question on how to generate and author sequential instructions for assitive systems. In this paper, we present a new concept and a prototypical implementation of an assitive system that can be taught by demonstrating an assembly process. By using a combination of RGB and depth cameras, we can generate an assembly instruction of Lego Duplo bricks based on the demonstration of a user. This generated manual can later on be used for assisting other users in the assembly process. By our prototype system, we show the technological feasibility of assistive systems that can learn from users.