Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Temporally consistent wide baseline facial performance capture via image warping

: Kettern, M.; Hilsmann, A.; Eisert, P.


European Association for Computer Graphics -EUROGRAPHICS-:
20th International Symposium on Vision, Modeling and Visualization, VMV 2015 : Aachen, Germany, October 07 - 10, 2015
Aire-la-Ville: Eurographics Association, 2015
ISBN: 978-3-905674-95-8
International Symposium on Vision, Modeling and Visualization (VMV) <20, 2015, Aachen>
Fraunhofer HHI ()

In this paper, we present a method for detailed temporally consistent facial performance capture that supports any number of arbitrarily placed video cameras. Using a suitable 3D model as reference geometry, our method tracks facial movement and deformation as well as photometric changes due to illumination and shadows. In an analysis-by-synthesis framework, we warp one single reference image per camera to all frames of the sequence thereby drastically reducing temporal drift which is a serious problem for many state-of-the-art approaches. Temporal appearance variations are handled by a photometric estimation component modeling local intensity changes between the reference image and each individual frame. All parameters of the problem are estimated jointly so that we do not require separate estimation steps that might interfere with one another.