Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

3D high-resolution multimodal imaging system for real-time applications

: Rosenberger, M.; Zhang, C.; Zhang, Y.; Notni, G.


Harding, K.G. ; Society of Photo-Optical Instrumentation Engineers -SPIE-, Bellingham/Wash.:
Dimensional Optical Metrology and Inspection for Practical Applications IX : 27 April - 8 May 2020, Online Only, United States
Bellingham, WA: SPIE, 2020 (Proceedings of SPIE 11397)
ISBN: 978-1-5106-3571-5
ISBN: 978-1-5106-3572-2
Paper 1139704, 10 S.
Conference "Dimensional Optical Metrology and Inspection for Practical Applications" <9, 2020>
Fraunhofer IOF ()

In this work, we developed a multimodal imaging system for real-time applications by integrating 2D image sensors in different spectral ranges as well as a polarization camera into a high-speed optical 3D sensor. For the generation of the multimodal image data, a pixel-level alignment of 2D images in different modalities to 3D data is realized by applying projection matrices to each point in the 3D point cloud. For the calculation of projection matrices for each 2D image sensor, a calibration procedure is proposed for the extrinsic calibration of arbitrarily positioned image sensors. The final imaging system delivers multimodal video data with one mega-pixel resolution at a frame rate of 30 Hz. As application examples, we demonstrate the estimation of vital signs and the detection of human body parts with this imaging system.