Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Real-time multimodal 3D imaging system for remote estimation of vital signs

: Zhang, C.; Gebhart, I.; Kühmstedt, P.; Rosenberger, M.; Notni, G.


Stella, Ettore (Hrsg.) ; Society of Photo-Optical Instrumentation Engineers -SPIE-, Bellingham/Wash.:
Multimodal Sensing and Artificial Intelligence. Technologies and Applications II : 21-26 June 2021, Online Only, Germany
Bellingham, WA: SPIE, 2021 (Proceedings of SPIE 11785)
Paper 117850F, 14 S.
Conference "Multimodal Sensing and Artificial Intelligence - Technologies and Applications" <2, 2021, Online>
Fraunhofer IOF ()
3D imaging; multimodal imaging; multispectral imaging; contactless vital sign estimation

The contactless estimation of vital signs based on conventional color cameras and ambient light can be affected by motions of patients and changes in ambient light. In this work, a multimodal 3D imaging system with an irritation-free controlled illumination was developed in order to mitigate these both problems. In the developed system the real-time high-precision 3D imaging is combined with VIS-NIR multispectral imaging and thermal imaging. Based on 3D data and color images, an approach was proposed for the efficient compensation of head motions, and novel approaches based on 3D regions of interest were developed for the estimation of heart rate, oxygen saturation, respiration rate, and body temperature from NIR multispectral video data and thermal video data. A proof-of-concept for the developed imaging system and algorithms can be delivered with first experimental results.