Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

A flexible approach to gesture recognition and interaction in X3D

: Franke, Tobias; Olbrich, Manuel; Fellner, Dieter W.


Mouton, Christophe (General Chair); Posada, Jorge (General Chair); Jung, Yvonne (Program Chair); Cabral, Marcio (Program Chair) ; Association for Computing Machinery -ACM-, Special Interest Group on Graphics -SIGGRAPH-; European Association for Computer Graphics -EUROGRAPHICS-; Web3D Consortium, Mountain View/Calif.:
Web3D 2012, 17th International Conference on 3D Web Technology. Proceedings : Los Angeles, CA, USA, August 4-5, 2012
New York: ACM Press, 2012
ISBN: 978-1-4503-1432-9
International Conference on 3D Web Technology (WEB3D) <17, 2012, Los Angeles/Calif.>
Conference Paper
Fraunhofer IGD ()
extensible 3D (X3D); interaction; gesture recognition; Forschungsgruppe Semantic Models, Immersive Systems (SMIS)

With the appearance of natural interaction devices such as the Microsoft Kinect or Asus Xtion PRO cameras, a whole new range of interaction modes have been opened up to developers. Tracking frameworks can make use of the additional depth image or skeleton tracking capabilities to recognize gestures. A popular example of one such implementation is the NITE framework from PrimeSense, which enables fine grained gesture recognition. However, recognized gestures come with additional information such as velocity, angle or accuracy, which are not encapsulated in a standardized format and therefore cannot be integrated into X3D in a meaningful way. In this paper, we propose a flexible way to inject gesture based meta data into X3D applications to enable fine grained interaction. We also discuss how to recognize these gestures if the underlying framework provides no mechanism to do so.