Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Convolutional Neural Networks for Semantic Segmentation as a Tool for Multiclass Face Analysis in Thermal Infrared

: Müller, David; Ehlen, Andreas; Valeske, Bernd

Volltext urn:nbn:de:0011-n-6213139 (1.7 MByte PDF)
MD5 Fingerprint: 08d7414c31f337fbf179060aaea349d8
(CC) by
Erstellt am: 14.1.2021

Journal of Nondestructive Evaluation 40 (2021), Nr.1, Art. 9, 10 S.
ISSN: 0195-9298
ISSN: 1573-4862
Zeitschriftenaufsatz, Elektronische Publikation
Fraunhofer IZFP ()
artificial intelligence; machine learning; thermography; intelligent sensor; health monitoring

Convolutional neural networks were used for multiclass segmentation in thermal infrared face analysis. The principle is based on existing image-to-image translation approaches, where each pixel in an image is assigned to a class label. We show that established networks architectures can be trained for the task of multiclass face analysis in thermal infrared. Created class annotations consisted of pixel-accurate locations of different face classes. Subsequently, the trained network can segment an acquired unknown infrared face image into the defined classes. Furthermore, face classification in live image acquisition is shown, in order to be able to display the relative temperature in real-time from the learned areas. This allows a pixel-accurate temperature face analysis e.g. for infection detection like Covid-19. At the same time our approach offers the advantage of concentrating on the relevant areas of the face. Areas of the face irrelevant for the relative temperature calculation or accessories such as glasses, masks and jewelry are not considered. A custom database was created to train the network. The results were quantitatively evaluated with the intersection over union (IoU) metric. The methodology shown can be transferred to similar problems for more quantitative thermography tasks like in materials characterization or quality control in production.