Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

UnrealGT: Using Unreal Engine to Generate Ground Truth Datasets

: Pollok, Thomas; Junglas, Lorenz; Ruf, Boitumelo; Schumann, Arne


Bebis, George (ed.):
Advances in Visual Computing. 14th International Symposium on Visual Computing, ISVC 2019. Proceedings. Pt.1 : Lake Tahoe, NV, USA, October 7-9, 2019
Cham: Springer Nature, 2020 (Lecture Notes in Computer Science 11844)
ISBN: 978-3-030-33719-3 (Print)
ISBN: 978-3-030-33720-9 (Online)
International Symposium on Visual Computing (ISVC) <14, 2019, Lake Tahoe/Nev.>
European Commission EC
H2020; 740754; VICTORIA
Video analysis for Investigation of Criminal and TerrORIst Activities
Conference Paper
Fraunhofer IOSB ()

Large amounts of data have become an essential requirement in the development of modern computer vision algorithms, e.g. the training of neural networks. Due to data protection laws, overflight permissions for UAVs or expensive equipment, data collection is often a costly and time-consuming task. Especially, if the ground truth is generated by manually annotating the collected data. By means of synthetic data generation, large amounts of image- and metadata can be extracted directly from a virtual scene, which in turn can be customized to meet the specific needs of the algorithm or the use-case. Furthermore, the use of virtual objects avoids problems that might arise due to data protection issues and does not require the use of expensive sensors. In this work we propose a framework for synthetic test data generation utilizing the Unreal Engine. The Unreal Engine provides a simulation environment that allows one to simulate complex situations in a virtual world, such as data acquisition with UAVs or autonomous diving. However, our process is agnostic to the computer vision task for which the data is generated and, thus, can be used to create generic datasets. We evaluate our framework by generating synthetic test data, with which a CNN for object detection as well as a V-SLAM algorithm are trained and evaluated. The evaluation shows that our generated synthetic data can be used as an alternative to real data.