Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

ICG based Augmented-Reality-System for Sentinel Lymph Node Biopsy

: Noll, Matthias; Noa-Rudolph, Werner; Wesarg, Stefan; Kraly, Michael; Stoffels, Ingo; Klode, Joachim; Spass, Cédric; Spass, Gerrit


Hotz, Ingrid (Ed.) ; European Association for Computer Graphics -EUROGRAPHICS-:
VCBM 2018, Eurographics Workshop on Visual Computing for Biology and Medicine : Granada, Spain, September 20 - 21, 2018
Aire-la-Ville: Eurographics Association, 2018
ISBN: 978-3-03868-056-7
Workshop on Visual Computing for Biology and Medicine (VCBM) <8, 2018, Granada>
Fraunhofer IGD ()
Guiding Theme: Individual Health; Research Area: Computer graphics (CG); Research Area: Computer vision (CV); Research Area: Human computer interaction (HCI); Augmented reality (AR); medical visualization; object tracking

In this paper we introduce a novel augmented-reality (AR) system for the sentinel lymph node (SLN) biopsy. The AR system consists of a cubic recording device with integrated stereo near-infrared (NIR) and stereo color cameras, an head mounted display (HMD) for visualizing the SLN information directly into the physicians view and a controlling software application. The labeling of the SLN is achieved using the fluorescent dye indocyanine green (ICG). The dye accumulates in the SLN where it is excited to fluorescence by applying infrared light. The fluorescence is recorded from two directions by the NIR stereo cameras using appropriate filters. Applying the known rigid camera geometry, an ICG depth map can be generated from the camera images, thus creating a live 3D representation of the SLN. The representation is then superimposed to the physicians field of view, by applying a series of coordinate system transformations, that are determined in four separate system calibration steps. To compensate for the head motion, the recording systems is continuously tracked by a single camera on the HMD using fiducial markers. Because the system does not require additional monitors, the physicians attention is kept solely on the operation site. This can potentially decrease the intervention time and render the procedure safer for the patient.