Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

3D Object Trajectory Reconstruction using Instance-Aware Multibody Structure from Motion and Stereo Sequence Constraints

: Bullinger, Sebastian; Bodensteiner, Christoph; Arens, Michael; Stiefelhagen, Rainer

Postprint urn:nbn:de:0011-n-5462850 (3.0 MByte PDF)
MD5 Fingerprint: a1538720cd0e411f66b80c4ad74afcee
© IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Created on: 6.6.2019

Institute of Electrical and Electronics Engineers -IEEE-:
30th IEEE Intelligent Vehicles Symposium, IV 2019 : 9-12 June 2019, Paris, France
Piscataway, NJ: IEEE, 2019
ISBN: 978-1-7281-0560-4
ISBN: 978-1-7281-0559-8
ISBN: 978-1-7281-0561-1
Intelligent Vehicles Symposium (IV) <30, 2019, Paris>
Conference Paper, Electronic Publication
Fraunhofer IOSB ()

Three-dimensional environment perception is a key element of autonomous driving and driver assistance systems. A common image based approach to determine threedimensional scene information is stereo matching, which is limited by the stereo camera baseline. In contrast to stereo matching based methods, we present an approach to reconstruct three-dimensional object trajectories combining temporal adjacent views for object point triangulation. We track twodimensional object shapes on pixel level exploiting instance aware semantic segmentation techniques and optical flow cues. We apply Structure from Motion (SfM) to object and background images to determine initial camera poses relative to object instances as well as background structures and refine the initial SfM results by integrating stereo camera constraints using factor graphs. We compute object trajectories using stereo sequence constraints of object and background reconstructions. We show qualitative results using publicly available video data of driving sequences. Due to the lack of suitable ground truth, we create a synthetic benchmark dataset of stereo sequences with vehicles in urban environments. Our algorithm achieves an average trajectory error of 0.09 meter using the dataset. The dataset is on our website publicly available.