Designing hybrid intelligence: understanding the impact of human decision-making on AI

In many domains such as management, production and government, established control approaches struggle to address increasing complexity in a timely manner, resulting in a demand for more agile methods. Hybrid intelligence and decision support systems are useful approaches to augment human decision-making through artificial intelligence (AI). Various application of AI methods to estimate production parameters or to provide forecasts are discussed in the literature or already being implemented, however, human decision-making is still required for either deciding whether to follow specific suggestions or for monitoring their respective implementation. But human behavioral research has shown that human decision-making is rather biased than fully rational, leading to unintended consequences in the collaborative work of humans and machines. Subsequently, the research stream of hybrid intelligence has gained interest recently, aiming to study the collaboration between humans and machines. We contribute to this issue by combining a systematic literature review on AI and cognitive biases combined with practical insights from discussions with experts in order to derive first guidelines addressing the human factor in the design of AI-based decision support systems for complex production environments.