Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

An experimental multimedia system allowing 3-D visualization and eye-controlled interaction without user-worn devices

: Pastoor, S.; Liu, J.; Renault, S.


IEEE transactions on multimedia 1 (1999), No.1, pp.41-52
ISSN: 1520-9210
Journal Article
Fraunhofer HHI ()
data visualisation; graphical user interfaces; multimedia systems; multimedia system; 3d visualization; eye-controlled interaction; user-worn devices; human-computer interface; prototype system; visual operating system; graphic user interface; autostereoscopic 3d displays; binocular vision; video-based head; gaze tracking; intelligent interface agent

In this paper, a new kind of human-computer interface allowing three-dimensional (3-D) visualization of multimedia objects and eye controlled interaction is proposed. In order to explore the advantages and limitations of the concept, a prototype system has been set up. The testbed includes a visual operating system for integrating novel forms of interaction with a 3-D graphic user interface, autostereoscopic (free-viewing) 3-D displays with close adaptation to the mechanisms of binocular vision, and solutions for nonintrusive eye-controlled interaction (video-based head and gaze tracking). The paper reviews the system's key components and outlines various applications implemented for user testing. Preliminary results show that most of the users are impressed by a 3-D graphic user interface and the possibility to communicate with a computer by simply looking at the object of interest. On the other hand, the results emphasize the need for a more intelligent interface agent to avoid misinterpretation of the user's eye-controlled input and to reset undesired activities.