Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Interaction in edutainment applications using monocular posture tracking

: Cerneková, Z.; Malerczyk, Cornelius; Nikolaidis, Nikos; Pitas, Ioannis

Computer Graphics & Geometry 10 (2008), Nr.2, S.25-33
ISSN: 1811-8992
Fraunhofer IGD ()
human-computer interaction (HCI); gesture recognition; edutainment; computer vision

In this paper, a method for recognizing pointing gestures without markers is proposed. The video-based system uses one camera only, which observes the user in front of a large screen and identifies the 2D position pointed by him/her on this screen, his/her arm being in the fully extended position towards the screen. A GVF-snake is used in order to detect the pointing hand of the user, which is tracked in the following frames using the particle filters tracker. The center of gravity of the snake is used as a feature point and is transformed using linear transformation directly into the canvas coordinates. The method was tested on a large screen using applications designed for a wide range of different and even technically unversed users such as an image exploration for a virtual museum exhibit or intuitive interaction applications for gaming purposes. Experiments show very promising results for recognizing the pointing gestures by using a single camera.