Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Lightweight palm and finger tracking for real-time 3D gesture control

: Hackenberg, G.; McCall, R.; Broll, W.


Hirose, M. ; Institute of Electrical and Electronics Engineers -IEEE-; IEEE Computer Society, Technical Committee on Visualization and Graphics:
2011 IEEE Virtual Reality Conference, VR 2011. Proceedings : Singapore, 19 - 23 March 2011
Piscataway, NJ: IEEE, 2011
ISBN: 978-1-457-70039-2
ISBN: 978-1-4577-0036-1
ISBN: 978-1-4577-0038-5
Virtual Reality Conference (VR) <18, 2011, Singapore>
Fraunhofer FIT ()

We present a novel technique implementing barehanded interaction with virtual 3D content by employing a time-of-flight camera. The system improves on existing 3D multi-touch systems by working regardless of lighting conditions and supplying a working volume large enough for multiple users. Previous systems were limited either by environmental requirements, working volume, or computational resources necessary for realtime operation. By employing a time-of-flight camera, the system is capable of reliably recognizing gestures at the finger level in real-time at more than 50 fps with commodity computer hardware using our newly developed precision hand and finger-tracking algorithm. Building on this algorithm, the system performs gesture recognition with simple constraint modeling over statistical aggregations of the hand appearances in a working volume of more than 8 cubic meters. Two iterations of user tests were performed on a prototype system, demonstrating the feasibili ty and usability of the approach as well as providing first insights regarding the acceptance of true barehanded touch-based 3D interaction.