Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Multi-camera piecewise planar object tracking with mutual information

: Fraissinet-Tachet, Matthieu; Schmitt, Michael; Wen, Zhuoman; Kuijper, Arjan


Journal of mathematical imaging and vision 56 (2016), Nr.3, S.591-602
ISSN: 0924-9907
ISSN: 1573-7683
Fraunhofer IGD ()
Guiding Theme: Visual Computing as a Service; Research Area: Computer vision (CV); Mutual information (MI); object tracking; 3D tracking; model-based tracking; template-based registration

Real-time and robust tracking of 3D objects based on a 3D model with multiple cameras is still an unsolved problem albeit relevant in many practical and industrial applications. Major problems are caused by appearance changes of the object. We present a template-based tracking algorithm for piecewise planar objects. It is robust against changes in the appearance of the object (occlusion, illumination variation, specularities). The version we propose supports multiple cameras. The method consists in minimizing the error between the observed images of the object and the warped images of the planes. We use the mutual information as registration function combined with an inverse composition approach for reducing the computational costs and get a near-real-time algorithm. We discuss different hypotheses that can be made for the optimization algorithm.