Fraunhofer-Gesellschaft

Publica

Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Findings of the WMT 2018 Biomedical Translation Shared Task

Evaluation on Medline test sets
 
: Neves, Mariana; Yepes, Antonio Jimeno; Névéol, Aurélie; Grozea, Cristian; Siu, Amy; Kittner, Madeleine; Verspoor, Karin

:
Fulltext (PDF; )

Bojar, O. ; Association for Computational Linguistics -ACL-:
WMT 2018, Third Conference on Machine Translation. Proceedings of the conference : October 31-November 1, 2018, Brussels, Belgium
San Francisco, Calif.: ACL, 2018
ISBN: 978-1-948087-81-0
pp.324-339
Conference on Machine Translation (WMT) <3, 2018, Brussels>
Conference on Empirical Methods in Natural Language Processing (EMNLP) <2018, Brussels>
English
Conference Paper, Electronic Publication
Fraunhofer FOKUS ()

Abstract
Machine translation enables the automatic translation of textual documents between languages and can facilitate access to information only available in a given language for non-speakers of this language, e.g. research results presented in scientific publications. In this paper, we provide an overview of the Biomedical Translation shared task in the Workshop on Machine Translation (WMT) 2018, which specifically examined the performance of machine translation systems for biomedical texts. This year, we provided test sets of scientific publications from two sources (EDP and Medline) and for six language pairs (English with each of Chinese, French, German, Portuguese, Romanian and Spanish). We describe the development of the various test sets, the submissions that we received and the evaluations that we carried out. We obtained a total of 39 runs from six teams and some of this year's BLEU scores were somewhat higher that last year's, especially for teams that made use of biomedical resources or state-of-the-art MTalgorithms (e.g. Transformer). Finally, our manual evaluation scored automatic translations higher than the reference translations for German and Spanish.

: http://publica.fraunhofer.de/documents/N-538014.html