Fraunhofer-Gesellschaft

Publica

Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Heterogeneous binocular camera-tracking in a virtual studio

 
: Flasko, M.; Pogscheba, P.; Herder, J.; Vonolfen, W.

:
Volltext urn:nbn:de:0011-n-1811347 (1.2 MByte PDF)
MD5 Fingerprint: 645b59b820676468425ff0a13dbced41
Erstellt am: 19.10.2011


Bohn, Christian-Arved (Hrsg.) ; Gesellschaft für Informatik -GI-, Fachgruppe Virtuelle Realität und Augmented Reality:
Virtuelle und Erweiterte Realität. 8. Workshop der GI-Fachgruppe VR/AR 2011 : 8. Workshop der GI-Fachgruppe VR/AR, 15.09.11 bis 16.09.11, Wedel
Aachen: Shaker, 2011 (Berichte aus der Informatik)
ISBN: 978-3-8440-0394-9
ISSN: 0945-0807
S.147-158
Workshop Virtuelle & Erweiterte Realität (VR/AR) <8, 2011, Wedel>
Englisch
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IAIS ()
camera calibration; stereo calibration; image registration; image processing; virtual studio; interaction

Abstract
This paper presents a tracking of parts of a human body in a virtual tv studio environment. The tracking is based on a depth camera and a HD studio camera and aims at a realistic interaction between the actor and the computer generated environment. Stereo calibration methods are used to match corresponding pixels of both cameras (HD color and depth image). Hence the images were rectied and column aligned. The disparity is used to correct the depth image pixel by pixel. This image registration results in row and column aligned images where ghost regions are in the depth image resulting from occlusion. Both images are used to generate foreground masks with chroma and depth keying. The color image is taken for skin color segmentation to determine and distinguish the actor's hands and face. I n the depth image the esh colored regions were used to determine their spatial position. The extracted positions were augmented by virtual objects. The scene is rendered correctly with virtual camera parameters which were calculated from the camera calibration parameters. Generated computer graphics with alpha value are combined with the HD color images. This compositing shows interaction with augmented objects for verification. The additional depth information results in changing the size of objects next to the hands when the actor moves around.

: http://publica.fraunhofer.de/dokumente/N-181134.html