Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Real time interaction with mobile robots using hand gestures

: Konda, K.R.; Königs, A.; Schulz, H.; Schulz, D.


Yanco, H. ; Association for Computing Machinery -ACM-, Special Interest Group on Artificial Intelligence -SIGART-; Association for Computing Machinery -ACM-, Special Interest Group on Computer and Human Interaction -SIGCHI-:
HRI 2012, 7th Annual ACM/IEEE International Conference on Human-Robot Interaction. Proceedings : Marc 5-8, 2012, Boston, Massachusetts, USA
New York: ACM, 2012
ISBN: 978-1-4503-1063-5
International Conference on Human-Robot Interaction (HRI) <7, 2012, Boston/Mass.>
Conference Paper
Fraunhofer FKIE ()

We developed a robust real time hand gesture based interaction system to effectively communicate with a mobile robot which can operate in an outdoor environment. The system enables the user to operate a mobile robot using hand gesture based commands. In particular the system offers direct on site interaction providing better perception of environment to the user. To overcome the illumination challenges in outdoors, the system operates on depth images. Processed depth images are given as input to a convolutional neural network which is trained to detect static hand gestures. The system is evaluated in real world experiments on a mobile robot to show the operational efficiency in outdoor environment.