Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Mirror-based multi-view analysis of facial motions

: Rurainsky, J.; Eisert, P.


Institute of Electrical and Electronics Engineers -IEEE-; IEEE Signal Processing Society:
IEEE International Conference on Image Processing, ICIP 2007. Vol.3 : September 16-19, 2007, San Antonio, Texas, USA
New York, NY: IEEE, 2007
ISBN: 978-1-4244-1436-9
ISBN: 1-4244-1436-9
ISBN: 978-1-4244-1437-6
International Conference on Image Processing (ICIP) <14, 2007, San Antonio/Tex.>
Conference Paper
Fraunhofer HHI ()
face recognition; mirror; motion compensation; motion estimation

We present our system for the capturing and analysis of 3D facial motion. A high speed camera is used as capture unit in combination with two surface mirrors. The mirrors provide two additional virtual views of the face without the need of multiple cameras and to avoid synchronization problems. We use this system to capture the motion of a person's face while speaking. Investigations of these facial motions are presented and rigid and non-rigid motion are analyzed. In order to extract only facial deformation independent from head pose, we use a new and simple approach for separating rigid and non-rigid motion named weight-compensated motion estimation (WCME). This approach weights the data points according to their influence to the desired motion model. We also present first results of our model-based facial deformation analysis. Such results can be used for facial animations in order to achieve a higher degree of quality.