Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Free viewpoint video extraction, representation, coding, and rendering

: Smolic, A.; Mueller, K.; Merkle, P.; Rein, T.; Kautzner, M.; Eisert, P.; Wiegand, T.


Institute of Electrical and Electronics Engineers -IEEE-:
International Conference on Image Processing, ICIP 2004. Vol.5 : Singapore, 24 - 27 October 2004
Piscataway, NJ: IEEE Operations Center, 2004
ISBN: 0-7803-8554-3
International Conference on Image Processing (ICIP) <2004, Singapore>
Fraunhofer HHI ()

Free viewpoint video provides the possibility to freely navigate within dynamic real world video scenes by choosing arbitrary viewpoints and view directions. So far, related work only considered free viewpoint video extraction, representation, and rendering methods. Compression and transmission has not yet been studied in detail and combined with the other components into one complete system. In this paper, we present such a complete system for efficient free viewpoint video extraction, representation, coding, and interactive rendering. Data representation is based on 3D mesh models and view-dependent texture mapping using video textures. The geometry extraction is based on a shape-from-silhouette algorithm. The resulting voxel models are converted into 3D meshes that are coded using MPEG-4 SNHC tools. The corresponding video textures are coded using an H.264/AVC codec. Our algorithms for view-dependent texture mapping have been adopted as an extension of MPEG-4 AFX. The presented results illustrate that based on the proposed methods a complete transmission system for efficient free viewpoint video can be built.