Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Real-time haptic interaction with RGBD video streams

: Rasool, Shahzad; Sourin, Alexei


The Visual Computer 32 (2016), Nr.10, S.1311-1321
ISSN: 0178-2789
ISSN: 1432-2315
Fraunhofer IDM@NTU ()
Fraunhofer IGD ()
tangible images; tangible video; Kinect; haptic rendering; Guiding Theme: Visual Computing as a Service; Guiding Theme: Digitized Work; Research Area: Human computer interaction (HCI); Research Area: Computer graphics (CG)

Video interaction is a common way of communication in cyberspace. It can become more immersive by incorporating haptic modality. Using commonly available depth sensing controllers like Microsoft Kinect, information about the depth of a scene can be captured in real-time together with the video. In this paper, we present a method for real-time haptic interaction with videos containing depth data. Forces are computed based on the depth information. Spatial and temporal filtering of the depth stream is used to provide stability of force feedback delivered to the haptic device. Fast collision detection ensures the proposed approach to be used in real-time. We present an analysis of various factors that affect algorithm performance. The usefulness of the approach is illustrated by highlighting possible application scenarios.