Automatisierte Adaption von Java-basierten Benutzeroberflächen in eine VR-Umgebung

Virtual Reality (VR) environments provide sophisticated 3D presentation and interaction facilities for a very specific task (fluid dynamics visualization, Digital Mock-Up etc.). There we find the typical input and out devices such as stereo displays, tracking sensors and data gloves. However, there is no esay way to access regular desktop applications. This group of applications, including web browsers, calculators, text editors or data base retrieval frontends, requires the traditional environments with mouse, keyboard and a 2D window system. This thesis demonstrates how to embed Java-SWING based user interfaces into an existing VR environment, the Java Studierstube (JSTB). JSTB allows two-handed interaction in virtual worlds by using a painter-like metaphor with the Personal Interaction Panel (PIP) and a Pen. Any legacy system with a SWING user interface can be embedded into a JSTB application by means of a so-called Pluggable Look&Feel. This feature of SWING which is noremally used to provide various styles (Motif, MS Windows etc.) is used to generate customized interaction elements such as buttons or sliders, for the virtual world, which can be operated with the available PIP and Pen input devices. Where a direct mapping can not be given, additional user interface elements have been introduced. This for example was necesary to support text input by means of a virtual keyboard.