From Body Movements to Music - a New Device for Movement Therapies

A device for music generation through movement is introduced which may be a new tool for therapies especially of persons with disabilities. The system connects fast 3D capturing of acting person(s) with high-resolution 2D images and specialized sound/music modules, which translate the detected movements into sound and musical phrases. In this paper, the main challenges and solutions of the project are presented. Experiments and applications with different groups of patients are described and evaluated.