Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Monocular 3D Vehicle Trajectory Reconstruction Using Terrain Shape Constraints

: Bullinger, Sebastian; Bodensteiner, Christoph; Arens, Michael

Volltext urn:nbn:de:0011-n-5125415 (2.3 MByte PDF)
MD5 Fingerprint: 35e89270618c99cd7e3f94c1d41b5ce7
Erstellt am: 18.10.2018

Institute of Electrical and Electronics Engineers -IEEE-:
21st International Conference on Intelligent Transportation Systems, ITSC 2018 : 4-7 November 2018, Maui, Hawaii
Piscataway, NJ: IEEE, 2018
ISBN: 978-1-7281-0323-5
ISBN: 978-1-7281-0321-1
ISBN: 978-1-7281-0322-8
ISBN: 978-1-7281-0324-2
International Conference on Intelligent Transportation Systems (ITSC) <21, 2018, Maui/Hawaii>
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IOSB ()

This work proposes a novel approach to reconstruct three-dimensional vehicle trajectories in monocular video sequences. We leverage state-of-the-art instance-aware semantic segmentation and optical flow methods to compute object video tracks on pixel level. This approach uses Structure from Motion to determine camera poses relative to vehicle instances and environment structures. We parameterize vehicle trajectories with a single variable by combining object and background reconstructions. The naive combination of vehicle and environment reconstruction results in inconsistent motion trajectories due to the scale ambiguity of SfM. We determine consistent object trajectories by projecting dense vehicle reconstructions on the terrain surface. Our scale ratio estimation approach shows no degenerated camera-vehicle-motions. We demonstrate the usefulness of our approach using publicly available video data of driving scenarios. We extend this evaluation showing trajectory reconstruction results using drone footage. We use synthetic data of vehicles in urban environments to evaluate the proposed algorithm. We achieve an average reconstruction-to-ground-truth distance of 0.17 meter.