Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Sensor data fusion for textured reconstruction and virtual representation of alpine scenes

: Häufel, Gisela; Bulatov, Dimitri; Solbrig, Peter


Michel, Ulrich (Ed.) ; Society of Photo-Optical Instrumentation Engineers -SPIE-, Bellingham/Wash.:
Earth Resources and Environmental Remote Sensing/GIS Applications VIII : 11-14 September 2017, Warsaw, Poland
Bellingham, WA: SPIE, 2017 (Proceedings of SPIE 10428)
ISBN: 978-1-5106-1320-1
Paper 1042805, 14 S.
Conference "Earth Resources and Environmental Remote Sensing/GIS Applications" <8, 2017, Warsaw>
Fraunhofer IOSB ()
alpine area; sensor data fusion; 3D-object extraction; rock face; overhang; road; visualisation; simulation

The concept of remote sensing is to provide information about a wide-range area without making physical contact with this area. If, additionally to satellite imagery, images and videos taken by drones provide a more up-to-date data at a higher resolution, or accurate vector data is downloadable from the Internet, one speaks of sensor data fusion. The concept of sensor data fusion is relevant for many applications, such as virtual tourism, automatic navigation, hazard assessment, etc. In this work, we describe sensor data fusion aiming to create a semantic 3D model of an extremely interesting yet challenging dataset: An alpine region in Southern Germany. A particular challenge of this work is that rock faces including overhangs are present in the input airborne laser point cloud. The proposed procedure for identification and reconstruction of overhangs from point clouds comprises four steps: Point cloud preparation, filtering out vegetation, mesh generation and texturing. Further object types are extracted in several interesting subsections of the dataset: Building models with textures from UAV (Unmanned Aerial Vehicle) videos, hills reconstructed as generic surfaces and textured by the orthophoto, individual trees detected by the watershed algorithm, as well as the vector data for roads retrieved from openly available shapefiles and GPS-device tracks. We pursue geo-specific reconstruction by assigning texture and width to roads of several pre-determined types and modeling isolated trees and rocks using commercial software. For visualization and simulation of the area, we have chosen the simulation system Virtual Battlespace 3 (VBS3). It becomes clear that the proposed concept of sensor data fusion allows a coarse reconstruction of a large scene and, at the same time, an accurate and up-to-date representation of its relevant subsections, in which simulation can take place.