Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB

Filters

6 1
Reset filters

Settings
Now showing 1 - 7 of 7
  • Publication
    Validation of XAI Explanations for Multivariate Time Series Classification in the Maritime Domain
    ( 2022)
    Veerappa, Manjunatha
    ;
    Anneken, Mathias
    ;
    Burkart, Nadia
    ;
    Huber, Marco
    Due to the lack of explanation towards their internal mechanism, state-of-the-art deep learning-based classifiers are often considered as black-box models. For instance, in the maritime domain, models that classify the types of ships based on their trajectories and other features perform well, but give no further explanation for their predictions. To gain the trust of human operators responsible for critical decisions, the reason behind the classification is crucial. In this paper, we introduce explainable artificial intelligence (XAI) approaches to the task of classification of ship types. This supports decision-making by providing explanations in terms of the features contributing the most towards the prediction, along with their corresponding time intervals. In the case of the LIME explainer, we adapt the time-slice mapping technique (LimeforTime), while for Shapley additive explanations (SHAP) and path integrated gradient (PIG), we represent the relevance of each input variable to generate a heatmap as an explanation. In order to validate the XAI results, the existing perturbation and sequence analyses for classifiers of univariate time series data is employed for testing and evaluating the XAI explanations on multivariate time series. Furthermore, we introduce a novel evaluation technique to assess the quality of explanations yielded by the chosen XAI method.
  • Publication
    Supported Decision-Making by Explainable Predictions of Ship Trajectories
    ( 2021)
    Burkart, Nadia
    ;
    Huber, Marco
    ;
    Anneken, Mathias
    Machine Learning and Deep Learning models make accurate predictions based on a specifically trained task. For instance, models that classify ship vessel types based on their trajectory and other features. This can support human experts while they try to obtain information on the ships, e.g., to control illegal fishing. Besides the support in predicting a certain ship type, there is a need to explain the decision-making behind the classification. For example, which features contributed the most to the classification of the ship type. This paper introduces existing explanation approaches to the task of ship classification. The underlying model is based on a Residual Neural Network. The model was trained on an AIS data set. Further, we illustrate the explainability approaches by means of an explanatory case study and conduct a first experiment with a human expert.
  • Publication
    Are you sure? Prediction revision in automated decision-making
    ( 2021)
    Burkart, Nadia
    ;
    Robert, Sebastian
    ;
    Huber, Marco
    With the rapid improvements in machine learning and deep learning, decisions made by automated decision support systems (DSS) will increase. Besides the accuracy of predictions, their explainability becomes more important. The algorithms can construct complex mathematical prediction models. This causes insecurity to the predictions. The insecurity rises the need for equipping the algorithms with explanations. To examine how users trust automated DSS, an experiment was conducted. Our research aim is to examine how participants supported by an DSS revise their initial prediction by four varying approaches (treatments) in a between-subject design study. The four treatments differ in the degree of explainability to understand the predictions of the system. First we used an interpretable regression model, second a Random Forest (considered to be a black box [BB]), third the BB with a local explanation and last the BB with a global explanation. We noticed that all participants improved their predictions after receiving an advice whether it was a complete BB or an BB with an explanation. The major finding was that interpretable models were not incorporated more in the decision process than BB models or BB models with explanations.
  • Publication
    Batch-wise Regularization of Deep Neural Networks for Interpretability
    ( 2020)
    Burkart, Nadia
    ;
    Faller, Philipp M.
    ;
    Peinsipp, Elisabeth
    ;
    Huber, Marco
    Fast progress in the field of Machine Learning and Deep Learning strongly influences the research in many application domains like autonomous driving or health care. In this paper, we propose a batch-wise regularization technique to enhance the interpretability for deep neural networks (NN) by means of a global surrogate rule list. For this purpose, we introduce a novel regularization approach that yields a differentiable penalty term. Compared to other regularization approaches, our approach avoids repeated creating of surrogate models during training of the NN. The experiments show that the proposed approach has a high fidelity to the main model and also results in interpretable and more accurate models compared to some of the baselines.
  • Publication
    Forcing Interpretability for Deep Neural Networks through Rule-based Regularization
    ( 2019)
    Burkart, Nadia
    ;
    Huber, Marco
    ;
    Faller, Philipp M.
    Remarkable progress in the field of machine learning strongly drives the research in many application domains. For some domains, it is mandatory that the output of machine learning algorithms needs to be interpretable. In this paper, we propose a rule-based regularization technique to enforce interpretability for neural networks (NN). For this purpose, we train a rule-based surrogate model simultaneously with the NN. From the surrogate, a metric quantifying its degree of explainability is derived and fed back to the training of the NN as a regularization term. We evaluate our model on four datasets and compare it to unregularized models as well as a decision tree (DT) based baseline. The rule-based regularization approach achieves interpretability and competitive accuracy.
  • Publication
    Gaussian Process based Dynamic Facial Emotion Tracking
    ( 2019)
    Dunau, Patrick
    ;
    Huber, Marco
    ;
    Beyerer, Jürgen
    Capturing the emotions of humans is of paramount importance in human-machine interaction. Here, emotions are typically extracted from the human's face recorded in image sequences. In this paper, tracking emotions from images is formulated as Bayesian state estimation problem where the system state represents the valence-arousal space of emotions. Handcrafted image features are first mapped to the valence-arousal space by means of a Gaussian process. To allow dynamic emotion tracking, a Kalman filter is derived, where an inequality constraint on the emotional state is employed in order to avoid a drifting state. Experiments based on two well-known facial expression datasets are performed to demonstrate the performance of the proposed approach.
  • Publication
    Comparison of Angle and Size Features with Deep Learning for Emotion Recognition
    ( 2019)
    Dunau, Patrick
    ;
    Huber, Marco
    ;
    Beyerer, Jürgen
    The robust recognition of a person's emotion from images is an important task in human-machine interaction. This task can be considered a classification problem, for which a plethora of methods exists. In this paper, the emotion recognition performance of two fundamentally different approaches is compared: classification based on hand-crafted features against deep learning. This comparison is conducted by means of well-established datasets and highlights the benefits and drawbacks of each approach.