Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Learning an infant body model from RGB-D data for accurate full body motion analysis

: Hesse, Nikolas; Pujades, Sergi; Romero, Javier; Black, Michael J.; Bodensteiner, Christoph; Arens, Michael; Hofmann, Ulrich G.; Tacke, Uta; Hadders-Algra, Mijna; Weinerger, Raphael; Müller-Felber, Wolfgang; Schröder, Sebastian A.


Frangi, A.F.:
Medical Image Computing and Computer Assisted Intervention, MICCAI 2018 : 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part I
Cham: Springer International Publishing, 2018 (Lecture Notes in Computer Science 11070)
ISBN: 978-3-030-00927-4 (Print)
ISBN: 978-3-030-00928-1 (Online)
ISBN: 3-030-00927-0
International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) <21, 2018, Granada>
Conference Paper
Fraunhofer IOSB ()
body model; data-driven; cerebral palsy; motion analysis; pose tracking; general movement assessment

Infant motion analysis enables early detection of neurodevelopmental disorders like cerebral palsy (CP). Diagnosis, however, is challenging, requiring expert human judgement. An automated solution would be beneficial but requires the accurate capture of 3D full-body movements. To that end, we develop a non-intrusive, low-cost, lightweight acquisition system that captures the shape and motion of infants. Going beyond work on modeling adult body shape, we learn a 3D Skinned Multi-Infant Linear body model (SMIL) from noisy, low-quality, and incomplete RGB-D data. SMIL is publicly available for research purposes at We demonstrate the capture of shape and motion with 37 infants in a clinical environment. Quantitative experiments show that SMIL faithfully represents the data and properly factorizes the shape and pose of the infants. With a case study based on general movement assessment (GMA), we demonstrate that SMIL captures enough information to allow medical assessment. SMIL provides a new tool and a step towards a fully automatic system for GMA.