Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Steps towards question answering with deep neural memory networks

: Ahmed, Sajawel
: Zicari, Roberto V.; Kindermann, Jörg

Volltext urn:nbn:de:0011-n-4670836 (1.7 MByte PDF)
MD5 Fingerprint: da1c7f0808b5ac708bf94c262a80eacc
Erstellt am: 26.9.2017

Frankfurt, 2017, IV, 70 S.
Frankfurt, Univ., Master Thesis, 2017
Master Thesis, Elektronische Publikation
Fraunhofer IAIS ()
Deep neural network; semantic relationship; machine learning; neuroscience

Since the rise of neural networks in science and industry much progress has been made in the field of Artificial Intelligence. In this thesis, steps towards automatic Question Answering (QA) on text passages are examined by applying deep neural networks with memory components to large-scale datasets for the greater aim of developing the human-like ability of reading some piece of text and answering arbitrary questions on it. We explore the neural models of LSTM and Memory Networks by using three major text datasets of SQuAD with SNLI for QA, and MSRP for Paraphrase Detection. We empirically show that the LSTM achieve high performance for the binary step towards QA and are in addition expandable to Paraphrase Detection with a performance close to the state-of-the-art. Besides, we demonstrate that in contrast to their success on the bAbI tasks Memory Networks are not suitable for QA on the realistic dataset of SQuAD. Finally, we discover the usability of the measure of cosine similarity on the internal hidden vectors of LSTM. The thesis is closed by presenting a semantic search algorithm for text pairs and its further development to use cases for the landscape of business activities.