Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

3D vehicle trajectory reconstruction in monocular video data using environment structure constraints

: Bullinger, Sebastian; Bodensteiner, Christoph; Arens, Michael; Stiefelhagen, Rainer

Postprint urn:nbn:de:0011-n-5067838 (8.7 MByte PDF)
MD5 Fingerprint: 8d1edd67b9b9c6d38dfe447263167901
The original publication is available at
Erstellt am: 23.8.2018

Ferrari, V.:
Computer Vision – ECCV 2018 : 15th European Conference, Munich, Germany, September 8-14, 2018, Proceedings, Part X
Cham: Springer International Publishing, 2018 (Lecture Notes in Computer Science 11214)
ISBN: 978-3-030-01249-6
ISBN: 978-3-030-01248-9
ISBN: 978-3-030-01250-2
European Conference on Computer Vision (ECCV) <15, 2018, Munich>
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IOSB ()
vehicle trajectory reconstruction; instance-aware semantic segmentation; Structure-from-Motion

We present a framework to reconstruct three-dimensional vehicle trajectories using monocular video data. We track two-dimensional vehicle shapes on pixel level exploiting instance-aware semantic segmentation techniques and optical ow cues. We apply Structure from Motion techniques to vehicle and background images to determine for each frame camera poses relative to vehicle instances and background structures. By combining vehicle and background camera pose information, we restrict the vehicle trajectory to a one-parameter family of possible solutions. We compute a ground representation by fusing background structures and corresponding semantic segmentations. We propose a novel method to determine vehicle trajectories consistent to image observations and reconstructed environment structures as well as a criterion to identify frames suitable for scale ratio estimation. We show qualitative results using drone imagery as well as driving sequences from the Cityscape dataset. Due to the lack of suitable benchmark datasets we present a new dataset to evaluate the quality of reconstructed three-dimensional vehicle trajectories. The video sequences show vehicles in urban areas and are rendered using the path-tracing render engine Cycles. In contrast to previous work, we perform a quantitative evaluation of the presented approach. Our algorithm achieves an average reconstruction-to-groundtruth-trajectory distance of 0.31 meter using this dataset. The dataset including evaluation scripts will be publicly available on our website.