Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Towards reconstructing a 3D face model from an uncontrolled video sequence

: Prithviraj, Jain Lalit; Seibert, Helmut; Kuijper, Arjan


Kuijper, Arjan (Ed.); Sourin, A. (Ed.); Fellner, Dieter W. (General Chairs) ; Fraunhofer-Institut für Graphische Datenverarbeitung -IGD-, Darmstadt; TU Darmstadt; European Association for Computer Graphics -EUROGRAPHICS-; Institute of Electrical and Electronics Engineers -IEEE-; International Federation for Information Processing -IFIP-, Working Group 5.10 Computer Graphics:
International Conference on Cyberworlds, CW 2012. Proceedings : 25-27 Sept. 2012, Darmstadt, Germany
Los Alamitos/Calif.: IEEE Computer Society Conference Publishing Services, 2012
ISBN: 978-0-7695-4814-2
ISBN: 978-1-4673-2736-7 (Print)
DOI: 10.1109/CW.2012.55
International Conference on Cyberworlds (CW) <11, 2012, Darmstadt>
Fraunhofer IGD ()
3D reconstruction; 3D model acquisition; video analysis

A pipeline for reconstructing the 3D face model from an uncontrolled video sequence is presented which involves three major steps. Firstly, a generic deformable 3D face model is built from the 3D scans of one hundred individuals. Secondly, the 3D faceshape from a video sequence is constructed by estimating poses of images using structure-from-motion technique and dense correspondences between those images by employing Huber-L1 optical flow algorithm. Finally, the generated generic deformable 3D face model can be fitted to the reconstructed 3D face-shape from a video sequence provided that the deviation from the real 3D face is less than certain thresholds. The application is developed to reconstruct the 3D face-shape in nearly uncontrolled environment so the results cannot be expected to be very accurate. We discuss the steps taken to perform the first and second steps. The factors affecting the depth estimation in face region cause major accuracy problems. They are analyzed and possible improvements to enhance the 3D face-shape reconstruction are presented.