Ultrahigh-resolution video as basis of a format-agnostic production system

In the future, new kinds of ultrahigh-resolution sensors and ultralarge displays will be available that will enable new production methods and immersive services in the home. At the Fraunhofer Heinrich Hertz Institute (HHI), a 6000 x 2000 (6k) pixels multicamera system (Omnicam) and a 7000 x 2000 pixels multiprojection system have been developed and different ultrahigh-resolution productions can already be viewed at the HHI's Tomorrow's immersive Media Experience (Time) Lab. The philosophy behind these activities is a ""format agnostic"" production system, which enables the merging of video signals from different sensors with different spatial and temporal resolution, such as from panorama cameras at 6k resolution and from high-speed cameras at high-definition resolution. Sophisticated three-dimensional image processing, in combination with appropriate metadata, will then allow combination of these different sources and subsequent extraction of sections from the complete image at a desired size and spatial/temporal resolution. This work will be continued within the Format-Agnostic Script-based Interactive Experience, a project of the European Union's Seventh Framework Programme.