Visual tracking for seamless 3D interactions in augmented reality
This paper presents a computer vision based approach for creating 3D tangible interfaces, which can facilitate real-time and flexible interactions with the augmented virtual world. This approach uses real-world objects and freehand gestures as interaction handles. The identity of these objects/gestures as well as their 3D pose in the physical world can be tracked in real-time. Once the objects and gestures are perceived and localized, the corresponding virtual objects can be manipulated dynamically by human operators who are operating on those real objects. Since the tracking algorithm is robust against background clutter and adaptable to illumination changes, it performs well in real-world scenarios, where both objects and cameras move rapidly in unconstrained environments.