Fraunhofer-Gesellschaft

Publica

Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

A platform for audiovisual telepresence using model- and data-based wave-field synthesis

 
: Heinrich, Gregor; Leitner, Michael; Jung, Christoph; Logemann, Fabian; Hahn, Volker

Audio Engineering Society -AES-:
125th Audio Engineering Society Convention 2008. Convention Papers. CD-ROM : October 2-5, 2008, San Francisco, CA, USA
New York, NY: AES, 2008
ISBN: 978-0-937803-65-3
Paper 7608, 14 pp.
Audio Engineering Society (Convention) <125, 2008, San Francisco/Calif.>
English
Conference Paper
Fraunhofer IGD ()
telepresence; audio; Auditory Rendering

Abstract
We present a platform for real-time transmission of immersive audiovisual impressions using model- and data- based audio wave-field analysis/synthesis and panoramic video capturing/projection. The audio subsystem considered in this paper is based on microphone arrays with different element counts and directivities as well as weakly directional loudspeaker arrays. We report on both linear and circular setups that feed different wave-field synthesis systems. In an attempt to extend this, we present first findings for a data-based approach derived using experimental simulations. This data-based wave-field analysis/synthesis (WFAS) approach uses a combination of cylindrical-harmonic decomposition of cardioid array signals and enforces causal plane wave synthesis by angular windowing and a directional delay term. Specifically, our contributions include (1) a high-resolution telepresence environment that is omnidirectional in both the auditory and visual modality, as well as (2) a study of data-based WFAS realistic microphone directivities as a contribution towards for real-time holophonic reproduction.

: http://publica.fraunhofer.de/documents/N-85665.html