Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Texture synthesis method for generic video sequences

: Ndjiki-Nya, P.; Stuber, C.; Wiegand, T.


Institute of Electrical and Electronics Engineers -IEEE-; IEEE Signal Processing Society:
IEEE International Conference on Image Processing, ICIP 2007. Vol.3 : September 16-19, 2007, San Antonio, Texas, USA
New York, NY: IEEE, 2007
ISBN: 978-1-4244-1436-9
ISBN: 1-4244-1436-9
ISBN: 978-1-4244-1437-6
International Conference on Image Processing (ICIP) <14, 2007, San Antonio/Tex.>
Conference Paper
Fraunhofer HHI ()
graph theory; image sequence; image texture; motion compensation; optimisation; spatiotemporal phenomena; video signal processing

An effective texture synthesis method is presented that is inspired by the work of Kwatra et al. [1]. Their algorithm is non-parametric and patch-based. Blending between overlapping patches is optimized using graph cut techniques. We generalize the initial approach [ 1 ] to achieve a new synthesis algorithm that yields improved results for a much larger class of natural video sequences. For that, two major extensions have been provided: (1) the ability to handle constrained texture synthesis applications and (2) robustness against global camera motion. Constrained synthesis thereby refers to integrating synthetic textures into natural video sequences, as opposed to unconstrained texture synthesis, where (infinite) spatio-temporal extensions of single textures are generated. Camera motion compensation enables applicability of the synthesis algorithm to video sequences with a moving camera. The results presented in this paper show that the proposed improvements yield significant subjective gains compared to the initial algorithm.