Fraunhofer-Gesellschaft

Publica

Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

3D Object Trajectory Reconstruction using Instance-Aware Multibody Structure from Motion and Stereo Sequence Constraints

 
: Bullinger, Sebastian; Bodensteiner, Christoph; Arens, Michael; Stiefelhagen, Rainer

:
Postprint urn:nbn:de:0011-n-5462850 (3.0 MByte PDF)
MD5 Fingerprint: a1538720cd0e411f66b80c4ad74afcee
© IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Erstellt am: 6.6.2019


Institute of Electrical and Electronics Engineers -IEEE-:
30th IEEE Intelligent Vehicles Symposium, IV 2019 : 9.6.-12.6.2019, Paris
Piscataway, NJ: IEEE, 2019
8 S.
Intelligent Vehicles Symposium (IV) <30, 2019, Paris>
Englisch
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IOSB ()

Abstract
Three-dimensional environment perception is a key element of autonomous driving and driver assistance systems. A common image based approach to determine threedimensional
scene information is stereo matching, which is limited by the stereo camera baseline. In contrast to stereo matching based methods, we present an approach to reconstruct three-dimensional object trajectories combining temporal adjacent views for object point triangulation. We track twodimensional object shapes on pixel level exploiting instanceaware semantic segmentation techniques and optical flow cues. We apply Structure from Motion (SfM) to object and background
images to determine initial camera poses relative to object instances as well as background structures and refine the initial SfM results by integrating stereo camera constraints using factor graphs.We compute object trajectories using stereo sequence constraints of object and background reconstructions. We show qualitative results using publicly available video data of driving sequences. Due to the lack of suitable ground truth, we create a synthetic benchmark dataset of stereo sequences with vehicles in urban environments. Our algorithm achieves an average trajectory error of 0.09 meter using the dataset. The dataset is on our website publicly available.

: http://publica.fraunhofer.de/dokumente/N-546285.html