An Ensemble of Benchmarks for the Evaluation of AI Methods for Fault Handling in CPPS

AI methods for fault handling in Cyber-Physical Production Systems (CPPS) such as production plants and tank systems are an emerging research topic. In the last years many methods for the detection of anomalies and faults, the diagnosis of the root cause and the automated repair have been developed. However, most of the methods are barely evaluated using a wide range of systems but applicability is shown using single use cases. In this paper, an ensemble of simulated benchmark systems is presented, which allows for a broad evaluation of AI methods for fault handling. The ensemble consists of seven different tank systems from process engineering with varying sizes and complexities and is made publicly available on Github. The suitability of the ensemble is shown using AI methods for fault handling such as anomaly detection, diagnosis and reconfiguration.