Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Eye tracking based interaction with 3D reconstructed objects

: Yoon, Sang Min; Graf, Holger


El Saddik, A. ; Association for Computing Machinery -ACM-, Special Interest Group on Multimedia -SIGMM-:
16th ACM International Conference on Multimedia 2008. CD-ROM. Proceedings : Vancouver, British Columbia, Canada, October 26-31, 2008
New York: ACM, 2008
ISBN: 978-1-60558-303-7
ISBN: 978-1-605-58319-8
ISBN: 978-1-605-58320-4
ISBN: 978-1-605-58312-9
ISBN: 978-1-605-58316-7
ISBN: 978-1-605-58314-3
ISBN: 978-1-605-58315-0
ISBN: 978-1-605-58309-9
ISBN: 978-1-605-58313-6
International Conference on Multimedia (MM) <16, 2008, Vancouver>
Fraunhofer IGD ()
eye tracking; 3D reconstruction; human-computer interaction (HCI)

This paper presents a method on how users might interact with objects which have been reconstructed from multiple images. Tracking the user's eye movement for HCI in an augmented reality environment provides a convenient, natural, and high-bandwidth source for navigating and zooming in/out of the 3D reconstructed object. The calculated 3D eye position, which is detected by multiple cues from a stereo camera, is synchronized with the 3D position of 3D reconstructed object. Our proposed method of image based 3D modelling is based on voxel carving with photo consistency check. Experimental results show that our proposed interaction methodology using a new solution of 3D eye tracking can be successfully applied for useful tools in context aware applications and improve its usability.