Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Robust 3D patch-based face hallucination

: Qu, C.; Herrmann, C.; Monari, Eduardo; Schuchert, Tobias; Beyerer, Jürgen

Postprint urn:nbn:de:0011-n-4562379 (1.5 MByte PDF)
MD5 Fingerprint: 11e2e85581a6ae58831c4e3edec56cc7
© IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Created on: 27.3.2018

Institute of Electrical and Electronics Engineers -IEEE-; IEEE Computer Society:
WACV 2017, IEEE Winter Conference on Applications of Computer Vision. Proceedings : 24-31 March 2017, Santa Rosa, California
Piscataway, NJ: IEEE, 2017
ISBN: 978-1-5090-4822-9
ISBN: 978-1-5090-4823-6
Winter Conference on Applications of Computer Vision (WACV) <17, 2017, Santa Rosa/Calif.>
Conference Paper, Electronic Publication
Fraunhofer IOSB ()

Incorporating 3D information has proven to be effective in many computer vision tasks and it is no exception in the context of facial analysis. However, limited application has been witnessed in face hallucination (FH), probably due to the difficulty of fitting 3D models onto low-resolution (LR) images. This paper presents a pure 3D approach to address this problem. By extending the LR image formation process to the 3D domain, the classic Lucas–Kanade algorithm is exploited to improve the precision of the error-prone 3D model fitting on LR images. The established correspondence between the input image and 3D training textures then facilitates reconstruction of high-resolution (HR) patches directly on the mesh, which can be employed to render realistic frontal faces for recognition. Extensive evaluation on several publicly available datasets reveals superior qualitative and quantitative results over state-of-the-art methods in fitting, FH and recognition, which shows the advantage of the proposed 3D framework over its 2D rivals, especially for non-frontal head poses and low image quality.