Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

2D hand tracking with motion information, skin color classification and aggregated channel features

: Hammer, J.-H.; Qu, C.; Voit, Michael; Beyerer, Jürgen

Fulltext (PDF; )

Jandieri, G.:
IPCV 2016, 20th International Conference on Image Processing, Computer Vision, & Pattern Recognition. Proceedings : July 25-28, 2016, Las Vegas, USA; held as part of WORLDCOMP 2016
Las Vegas: CSREA Press, 2016
ISBN: 1-60132-442-1
ISBN: 978-1-60132-363-7
ISBN: 1-60132-363-8
International Conference on Image Processing, Computer Vision, & Pattern Recognition (IPCV) <20, 2016, Las Vegas/Nev.>
World Congress in Computer Science, Computer Engineering, and Applied Computing (WorldComp) <2016, Las Vegas/Nev.>
Conference Paper, Electronic Publication
Fraunhofer IOSB ()
hand tracking; hand gesture; object detection; skin color; optical flow

In this paper we present our latest approach for 2D hand tracking in video streams of head-worn monocular color cameras. Those are lightweight and embedded in many head-mounted devices (HMDs) like eye trackers, Augmented Reality glasses or Virtual Reality devices to capture the field of view from the ego perspective. Interaction with virtual elements of the augmented or virtual reality or the interaction with the device itself can be intuitively performed using the hands. Our new approach called AfM fuses our previous method called Motion Segmentation and Appearance Change Detection based Skin color detection (MACS) with the results of a hand detector using Aggregated Channel Features. It tracks the hand more robustly and reduces the deviation from the ground truth paths by 50% on our benchmark with more than 25,000 frames consisting of different hand gestures.