Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Robust finger gesture recognition on handheld devices for spatial programming of industrial robots

: Lambrecht, J.; Walzel, H.; Krüger, J.


IEEE Robotics and Automation Society:
IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2013 : Gyeongju, South Korea, 26 - 29 August 2013
Piscataway, NJ: IEEE, 2013
ISBN: 978-1-4799-0508-9 (print)
ISBN: 978-1-4799-0509-6 (online)
ISBN: 978-1-4799-0507-2 (online)
International Symposium on Robot and Human Interactive Communication (RO-MAN) <22, 2013, Gyeongju>
Conference Paper
Fraunhofer IPK ()

We have developed a spatial programming system for industrial robots based on gestures and Augmented Reality. In this respect, we aim for a markerless and robust finger gesture recognition on the handheld devices. The user should be enabled to interact with virtual objects representing the robot program in front of the device. The great challenge is to be fast and robust in terms of diffuse background and changing environmental conditions. In this contribution, we present an image-based finger gesture recognition approach which is tailored to efficient implementation on mobile devices, e.g. Smartphones and Tablet PCs. For this purpose, we introduce an adaptive, rule-based skin classifier. The tracking is done by a specific particle filter: the Condensation algorithm. Due to further implemented improvements, we reduce the number of particles in order to reduce the computational time of the algorithm. The gesture recognition is implemented in an Android app, enabling the user to translate and rotate virtual object within an Augmented Reality application in real-time.