Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Source separation for enabling dialogue enhancement in object-based broadcast with MPEG-H

: Paulus, Jouni; Torcoli, Matteo; Uhle, Christian; Herre, Jürgen; Disch, Sascha; Fuchs, Harald

Fulltext urn:nbn:de:0011-n-5588199 (335 KByte PDF)
MD5 Fingerprint: ba2db6c16fe264a2524745301a691ec6
Created on: 18.9.2020

Journal of the Audio Engineering Society 67 (2019), No.7-8, pp.510-521
ISSN: 0004-7554
ISSN: 1549-4950
Journal Article, Electronic Publication
Fraunhofer IIS ()

Low intelligibility of narration or dialogue resulting from high background level is one of the most common complaints in broadcasting. Even when the intelligibility is not compromised, listeners may have personal preferences that differ from the mix being broadcast. Dialogue Enhancement (DE) enables the delivery of optimal dialogue mixing to each listener, be it in terms of intelligibility or for aesthetic preference. This makes DE one of the most promising applications of user interactivity enabled by object-based audio broadcasting, such as MPEG-H. This paper investigates the use of source separation methods to extract dialogue and background from the complex sound mixture for enabling object-based broadcasting when dialogue is not available from the production process, as for example, with legacy content. The presented source separation technology integrates several separation approaches with known limitations into a more powerful overall architecture. In addition, the paper evaluates the subjective benefit of DE using the Adjustment/Satisfaction Test in which the listeners made extensive use of the dialogue level personalization. The fact that the preferred dialogue level had a high variance among the listeners indicates the need for this functionality. Even when an imperfect separation result was used for enabling DE, the possibility for personalizing the dialogue level lead to increased listener satisfaction.