Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Context-aware patch-based method for façade inpainting

: Kottler, Benedikt; Bulatov, Dimitri; Xingzi, Zhang

Volltext urn:nbn:de:0011-n-5829463 (5.0 MByte PDF)
MD5 Fingerprint: 5e3a27b3f8110094e12bd5a4bcb84b30
(CC) by-nc-nd
Erstellt am: 18.6.2021

Bouatouch, K. ; Institute for Systems and Technologies of Information, Control and Communication -INSTICC-, Setubal:
15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications. Proceedings. Vol.1: GRAPP : Valletta, Malta, Feb 27, 2020 - Feb 29, 2020
Setubal: SciTePress, 2020
ISBN: 978-989-758-402-2
International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) <15, 2020, Valletta>
International Conference on Computer Graphics Theory and Applications (GRAPP) <2020, Valletta>
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IOSB ()
Fraunhofer Singapore ()
city modeling; inpainting; patch-based inpainting; texture image; Lead Topic: Smart City; Research Line: Computer graphics (CG); Research Line: Machine Learning (ML); image enhancement; context aware computing; image-based reconstruction

Realistic representations of 3D urban scenes is an important aspect of scene understanding and has many applications. Given untextured polyhedral Level-of-Detail 2 (LoD2) models of building and imaging containing façade textures, occlusions caused by foreground objects are an essential disturbing factor of façade textures. We developed a modification of a well-known patch-based inpainting method and used the knowledge about façade details in order to improve the façade inpainting of occlusions. Our modification focuses on suppression of undesired, superfluous repetitions of textures. To achieve this, a coarse inpainting result by a structural-based method is used to influence the choice of the best patch so that homogeneous regions are preferred. The coarse inpainting is calculated using the context knowledge and average color instead of traditionally applied arbitrary structural inpainting. Our modification furthermore introduces a parameter that allows to weight the influence of the coarse inpainting. A parameter study shows that this parameter can be chosen intuitively and does not require any parameter choice method. The cleaned façade textures could be successfully integrated into the accordingly adjusted building models thus upgrading them to LoD3.