Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Disparity/segmentation analysis: Matching with an adaptive window and depth-driven segmentation

: Izquierdo, E.


IEEE transactions on circuits and systems for video technology 9 (1999), No.4, pp.589-607
ISSN: 1051-8215
ISSN: 1558-2205
Journal Article
Fraunhofer HHI ()
edge detection; estimation theory; image matching; image segmentation; image sequences; stereo image processing; video signal processing; adaptive window; depth-driven segmentation; content-based multimedia technologies; machine early vision tasks; object segmentation; single image processing; pixel-correspondence estimation; multiview image analysis; leading-edge interactive video-communication technologies; telepresence systems; video sequences; stereo-image analysis; block matching; reference window; reliability; disparities; object borders; image areas; sampling positions; contour-matching algorithm; multiscale algorithm

Most of the emerging content-based multimedia technologies are based on efficient methods to solve machine early vision tasks. Among other tasks, object segmentation is perhaps the most important problem in single image processing, whereas pixel-correspondence estimation is the crucial task in multiview image analysis. The solution of these two problems is the key for the development of the majority of leading-edge interactive video-communication technologies and telepresence systems. In this paper, we present a robust framework comprised of joined pixel-correspondence estimation and image segmentation in video sequences taken simultaneously from different perspectives. An improved concept for stereo-image analysis based on block matching with a local adaptive window is introduced. The size and shape of the reference window is calculated adaptively according to the degree of reliability of disparities estimated previously. Considerable improvements are obtained just within object borders or image areas that become occluded by applying the proposed block-matching model. An initial object segmentation is obtained by merging neighboring sampling positions with disparity vectors of similar size and direction. Starting from this initial segmentation, true object borders are detected using a contour-matching algorithm. In this process, the contour of the initial segmentation is taken as a reference pattern, and the edges extracted from the original images, by applying a multiscale algorithm, are the candidates for the true object contour. The performance of the introduced methods has been verified.