Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Combined motion and depth estimation based on multiocular image sequences for 3D TV

: Skerjanc, R.

Fisher, S.S.; Merritt, J.O.; Bolas, M.T. ; Society of Photo-Optical Instrumentation Engineers -SPIE-, Bellingham/Wash.:
Stereoscopic Displays and Virtual Reality Systems : Combines the presentations from the Conference on Stereoscopic Displays and Applications V and from a new and complementary Conference on the Engineering Reality of Virtual Reality
Bellingham/Washington, 1994 (SPIE Proceedings Series 2177)
ISBN: 0-8194-1472-7
Conference on Stereoscopic Displays and Applications <5, 1994, San Jose/Calif.>
Conference on the Engineering Reality of Virtual Reality <1994, San Jose/Calif.>
Conference Paper
Fraunhofer HHI ()
image reconstruction; image sequences; light coherence; motion estimation; stereo image processing; three-dimensional television; multiocular image sequences; 3d tv; stereo motion analysis algorithm; virtual camera position; reconstruction; 3d line segments; triangulation; 2d line segments; multiocular stereo; reliable estimation; pentaocular camera rig; subconstellations; prazdny's coherence principle; multi-camera rig; 4d space-time model; multi-camera motion

This paper describes a new robust stereo and motion analysis algorithm to meet special demands of a multiview 3D TV system. Based on this algorithm, images can be synthesized for any virtual camera position within the array covered by the real cameras. This way it will be possible e.g. to create any number of perspective views needed for smooth motion parallax in multiview systems. For the reconstruction of a scene, 3D line segments are estimated by triangulation of corresponding 2D line segments (disparity estimation). This estimation of 3D segments is carried out more dependably by the combination of stereo and motion information and-to achieve further improvements-the utilisation of multiocular stereo. New measures for a more reliable estimation of the scene are proposed. These are especially the use of a pentaocular camera rig and grouping the cameras into sub-constellations in order to exploit the false positive/false negative trade-off in the match for the stereo correspondence. To achieve subjectively error-free estimations, Prazdny's coherence principle is extended to be applied to motion and image sequences as well as sub-constellations of the multi-camera rig. This algorithm comes up with a 4D space-time model of the scene by the co-operation of multi-camera motion and stereo.