Analysis of Metrics for Image Comparison in the Context of Automated Testing of Iterative Rendering Technologies

Automatic Quality Assurance in modern software development is inevitable for cost reduction and efficiency. Besides the correctness of the software, the performance and user-perception are essential subjects of testing. For 3D visualisation software like instant3Dhub, quantifying the quality of user perception is a challenging task. We will examine different metrics with respect to their prediction of the user perception and thus the quality of the 3D visualisation. We conclude how these metrics reflect human perception and where the limits of these approaches lie.