Augmented reality in medical applications

This paper introduces into the field of Augmented Reality, where virtual scenes are integrated into real environments. It describes the characteristic features, stressing the different image merging techniques (video based or optical), including a description of new devices like a virtual retinal display (VRD). Based on the knowledge of current AR-projects at ZGDV, Darmstadt, Germany, furthermore the important AR questions, which are tracking and registration will be discussed. Since the medical field is one of the most challenging areas, where Augmented Reality can be applied, a closer look to medical applications, i.e. for training and treatment planning, will be given. Herewith, current AR-projects within the medical area will be introduced. A combined rendering of real patient data with data coming from different modalities like MRI, CT, or ultrasound, allows the physician to "see inside" the patient, without looking at different output devices. In addition novice physicians could be guided by AR-techniques, by showing them computer-generated instructions (i.e. to identify organs or other specific locations) at the actual treatment area, thus the physician does not need to change his current center of interest.