Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Stereo matching for enhanced telepresence in three-dimensional videocommunications

: Izquierdo, E.


IEEE transactions on circuits and systems for video technology 7 (1997), Nr.4, S.629-643
ISSN: 1051-8215
ISSN: 1558-2205
Fraunhofer HHI ()
correlation methods; edge detection; image matching; image segmentation; image sequences; interpolation; motion estimation; smoothing methods; stereo image processing; visual communication; three-dimensional videocommunications; stereo matching; telepresence; disparity estimation; stereo sequences; intermediate views synthesis; stereo image analysis; modified block matching algorithm; cost function; area based correlation; weighted temporal smoothness; confidence measure; estimated correspondences reliability; occluded image areas; image points; unreliable motion assignment; unreliable disparity assignment; edge assisted vector interpolation; image synthesis; stereo cameras; computer simulations; continuous motion parallax; image quality

A robust approach for joint motion and disparity estimation in stereo sequences to synthesize arbitrary intermediate views is presented. The improved concept for stereo image analysis is based on a modified block matching algorithm. In which a cost function consisting of area-based correlation together with an appropriately weighted temporal smoothness term is applied. A confidence measure to evaluate the reliability of estimated correspondences is introduced. In occluded image areas and image points with unreliable motion or disparity assignments, considerable improvements are obtained applying an edge-assisted vector interpolation strategy. Two different image synthesis concepts are presented as well. The reported approach is verified by processing a set of sequences taken with stereo cameras having large interaxial distances. Computer simulations show that telepresence illusion with continuous motion parallax and good image quality can be obtained using the methods presented.