Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Time-frequency masking based online speech enhancement with multi-channel data using convolutional neural networks

: Chakrabarty, S.; Wang, D.; Habets, E.A.P.


Saruwatari, H. ; Institute of Electrical and Electronics Engineers -IEEE-:
16th International Workshop on Acoustic Signal Enhancement, IWAENC 2018. Proceedings : 17th-20th September 2018, Tokyo, Japan
Piscataway, NJ: IEEE, 2018
ISBN: 978-1-5386-8151-0
ISBN: 978-1-5386-8150-3
ISBN: 978-1-5386-8152-7
International Workshop on Acoustic Signal Enhancement (IWAENC) <16, 2018, Tokyo>
Fraunhofer IIS ()

Speech enhancement in noisy and reverberant conditions remains a challenging task. In this work, a time-frequency masking based method for speech enhancement with multi -channel data using convolutional neural networks (CNN) is proposed, where the CNN is trained to estimate the ideal ratio mask by discriminating directional speech source from diffuse or spatially uncorrelated noise. The proposed method operates on, frame-by-frame, the magnitude and phase components of the short-time Fourier transform coefficients of all frequency sub-bands and microphones. The avoidance of temporal context and explicit feature extraction makes the proposed method suitable for online implementation. In contrast to most speech enhancement methods that utilize multi -channel data, the proposed method does not require information about the spatial position of the desired speech source. Through experimental evaluation with both simulated and real data, we show the robustness of the proposed method to unseen acoustic conditions as well as varying noise levels.