Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Temporally consistent handling of disocclusions with texture synthesis for depth-image-based rendering

: Köppel, M.; Ndjiki-Nya, P.; Doshkov, D.; Lakshman, H.; Merkle, P.; Müller, K.; Wiegand, T.


Institute of Electrical and Electronics Engineers -IEEE-; IEEE Signal Processing Society:
17th IEEE International Conference on Image Processing, ICIP 2010 : Hong Kong, 26 - 29. September 2010
Piscataway/NJ: IEEE, 2010
ISBN: 978-1-4244-7994-8 (online)
ISBN: 978-1-4244-7992-4 (print)
ISBN: 978-1-4244-7993-1
ISSN: 1522-4880
International Conference on Image Processing (ICIP) <17, 2010, Hong Kong>
Fraunhofer HHI ()

Depth-image-based rendering (DIBR) is used to generate additional views of a real-world scene from images or videos and associated per-pixel depth information. An inherent problem of the view synthesis concept is the fact that image information which is occluded in the original view may become visible in the "virtual" image. The resulting question is: how can these disocclusions be covered in a visually plausible manner? In this paper, a new temporally and spatially consistent hole filling method for DIBR is presented. In a first step, disocclusions in the depth map are filled. Then, a background sprite is generated and updated with every frame using the original and synthesized information from previous frames to achieve temporally consistent results. Next, small holes resulting from depth estimation inaccuracies are closed in the textured image, using methods that are based on solving Laplace equations. The residual disoccluded areas are coarsely initialized and subse quently refined by patch-based texture synthesis. Experimental results are presented, highlighting that gains in objective and visual quality can be achieved in comparison to the latest MPEG view synthesis reference software (VSRS).