• English
  • Deutsch
  • Log In
    or
  • Research Outputs
  • Projects
  • Researchers
  • Institutes
  • Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Artikel
  4. Are you sure? Prediction revision in automated decision-making
 
  • Details
  • Full
Options
2021
Journal Article
Titel

Are you sure? Prediction revision in automated decision-making

Abstract
With the rapid improvements in machine learning and deep learning, decisions made by automated decision support systems (DSS) will increase. Besides the accuracy of predictions, their explainability becomes more important. The algorithms can construct complex mathematical prediction models. This causes insecurity to the predictions. The insecurity rises the need for equipping the algorithms with explanations. To examine how users trust automated DSS, an experiment was conducted. Our research aim is to examine how participants supported by an DSS revise their initial prediction by four varying approaches (treatments) in a between-subject design study. The four treatments differ in the degree of explainability to understand the predictions of the system. First we used an interpretable regression model, second a Random Forest (considered to be a black box [BB]), third the BB with a local explanation and last the BB with a global explanation. We noticed that all participants improved their predictions after receiving an advice whether it was a complete BB or an BB with an explanation. The major finding was that interpretable models were not incorporated more in the decision process than BB models or BB models with explanations.
Author(s)
Burkart, Nadia
Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB
Robert, Sebastian
Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB
Huber, Marco
Fraunhofer-Institut für Produktionstechnik und Automatisierung IPA
Zeitschrift
Expert systems
DOI
10.1111/exsy.12577
File(s)
N-593224.pdf (5.12 MB)
Language
English
google-scholar
Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB
Fraunhofer-Institut für Produktionstechnik und Automatisierung IPA
Tags
  • experiment

  • explainable ML

  • interpretability

  • prediction revision

  • Automation

  • decision making

  • decision support syst...

  • decision trees

  • deep learning

  • logistic regression

  • Versuch

  • maschinelles Lernen

  • Prognoseverfahren

  • Explainable Artificia...

  • Künstliche Intelligen...

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Send Feedback
© 2022