Performance Assessment for Artificial Intelligence-Based Data Analysis in Ultrasonic Guided Wave-Based Inspection: A Comparison to Classic Path-Based Probability of Detection

Performance assessment for GuidedWave (GW)-based Structural Health Monitoring (SHM) systems is of major importance for industrial deployment. With conventional feature extraction methods like damage indices, path-based probability of detection (POD) analysis can be realized. To achieve reliability quantification enough data needs to be available, which is rarely the case. Alternatives like methods for performance assessment on system level are still in development and in a discussion phase. In this contribution, POD results using an Artificial Intelligence (AI)-based data analysis are compared with those delivered by conventional data analysis. Using an open-access dataset from Open Guided Wave platform, the possibility of performance assessment for GW-based SHM systems using AI-based data analysis is shown in detail. An artificial neural network (ANN) classifier is trained to detect artificial damage in a stiffened CFRP plate. As input for the ANN, classical damage indicators are used. The ANN is tested to detect damage at another position, whose inspection data were not previously used in training. The findings show very high detection capabilities without sorting any specific path but only having a global view of current damage metrics. The systematic evaluation of the ANN predictions with respect to specific damage sizes allows to compute a probability of correct identification versus flaw dimension, somehow equivalent to and compared with the results achieved through classic path-based POD analysis. Also, sensitive paths are detected by ANN predictions allowing for evaluation of maximal distances between path and damage position. Finally, it is shown that the prediction performance of the ANN can be improved significantly by combining different damage indicators as inputs.