Fraunhofer-Gesellschaft

Publica

Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

D-ID-Net: Two-Stage Domain and Identity Learning for Identity-Preserving Image Generation from Semantic Segmentation

 
: Damer, Naser; Boutros, Fadi; Kirchbuchner, Florian; Kuijper, Arjan

:

Institute of Electrical and Electronics Engineers -IEEE-; IEEE Computer Society:
IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2019. Proceedings : 27 October - 2 November 2019, Seoul, Korea
Los Alamitos, Calif.: IEEE Computer Society Conference Publishing Services (CPS), 2019
ISBN: 978-1-7281-5024-6
ISBN: 978-1-7281-5023-9
S.3677-3682
International Conference on Computer Vision (ICCV) <17, 2019, Seoul>
OpenEDS Workshop <2019, Seoul>
Englisch
Konferenzbeitrag
Fraunhofer IGD ()
Lead Topic: Smart City; Lead Topic: Visual Computing as a Service; Research Line: Computer vision (CV); biometrics; Head mounted displays; image generation; CRISP

Abstract
Training functionality-demanding AR/VR systems require accurate and robust gaze estimation and tracking solutions. Achieving such a performance requires the availability of diverse eye image data that might only be acquired by the means of image generation. Works addressing the generation of such images did not target realistic and identity-specific images, nor did they address the practical relevant case of generation from semantic labels. Therefore, this work proposes a solution to generate realistic and identity-specific images that correspond to semantic labels, given samples of a specific identity. Our proposed solution consists of two stages. In the first stage, a network is trained to transform the semantic label into a corresponding eye image of a generic identity. The second stage is an identity-specific network that induces identity details on the generic eye image. The results of our D-ID-Net solutions shows a high degree of identity-preservation and similarity to the ground-truth images, with an RMSE of 7.235.

: http://publica.fraunhofer.de/dokumente/N-582903.html