Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Using the marginalised particle filter for real-time visual-inertial sensor fusion

: Bleser, Gabriele; Stricker, Didier


Livingston, M.A. ; Institute of Electrical and Electronics Engineers -IEEE-; Association for Computing Machinery -ACM-:
7th IEEE 2008, International Symposium on Mixed and Augmented Reality. Proceedings : Cambridge, UK September 15 - 18, 2008
Piscataway, NJ: IEEE, 2008
ISBN: 978-1-424-42840-3
International Symposium on Mixed and Augmented Reality (ISMAR) <7, 2008, Cambridge>
Conference Paper
Fraunhofer IGD ()
sensor fusion; Kalman filter; realtime

The use of a particle filter (PF) for camera pose estimation is an ongoing topic in the robotics and computer vision community, especially since the FastSLAM algorithm has been utilised for simultaneous localisation and mapping (SLAM) applications with a single camera. The major problem in this context consists in the poor proposal distribution of the camera pose particles obtained from the weak motion model of a camera moved freely in 3D space. While the FastSLAM 2.0 extension is one possibility to improve the proposal distribution, this paper addresses the question of how to use measurements from low-cost inertial sensors (gyroscopes and accelerometers) to compensate for the missing control information. However, the integration of inertial data requires the additional estimation of sensor biases, velocities and potentially accelerations, resulting in a state dimension, which is not manageable by a standard PF. Therefore, the contribution of this paper consists in developing a real-time capable sensor fusion strategy based upon the marginalised particle filter (MPF) framework. The performance of the proposed strategy is evaluated in combination with a markerbased tracking system and results from a comparison with previous visual-inertial fusion strategies based upon the extended Kalman filter (EKF), the standard PF and the MPF are presented.