Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Real-time hyperspectral stereo processing for the generation of 3D depth information

: Heide, Nina; Frese, Christian; Emter, Thomas; Petereit, Janko

Postprint urn:nbn:de:0011-n-5099433 (5.0 MByte PDF)
MD5 Fingerprint: 9db5acb6712d0dbb8a6d59d5de6b83be
© IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Erstellt am: 18.9.2018

Institute of Electrical and Electronics Engineers -IEEE-:
25th IEEE International Conference on Image Processing, ICIP 2018 : October 7-10, 2018, Athens, Greece
Piscataway, NJ: IEEE, 2018
ISBN: 978-1-4799-7061-2
ISBN: 978-1-4799-7062-9
International Conference on Image Processing (ICIP) <25, 2018, Athens>
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IOSB ()
hyperspectral imaging; stereo vision; real-time stereo matching; GPU processing

We present a local stereo matching method for hyperspectral camera data, allowing multiple usage of camera hardware and imaging data such as for object classification or spectral analysis and multichannel input to the correspondence problem. The matching process combines correlation-based similarity measures for pixel windows utilizing all 16 spectral channels followed by a consistency check for disparity selection. We evaluate stereo-processing methods focusing on effectiveness and runtime of the processing on a CPU and analyze parallelization possibilities. Based on the results of the evaluation on the CPU, we implement the optimized stereo matching for images with 16 channels on a graphics processing unit (GPU) utilizing the Compute Unified Device Architecture (CUDA). The parallel processing of the calculation steps to obtain the disparity image on the GPU achieves more than 27× speed up, resulting in calculation and post-processing of hyperspectral images with 8 – 13 Hz, depending on the selection of maximum disparity. The 3D reconstruction achieves a mean square error of 0.0267 m 2 in distance measurements from 5 – 10 m2.