Potential and challenges of using computer graphics for the simulation of optical measurement systems

Physically-based image synthesis methods, a research direction in computer graphics (CG), are capable of simulating optical measuring systems in their entirety and thus constitute an interesting approach for the development, simulation, optimization, and validation of such systems. In addition, other CG methods, so called procedural modeling techniques, can be used to quickly generate large sets of virtual samples and scenes thereof that comprise the same variety as physical testing objects and real scenes (e.g., if digitized sample data is not available or difficult to acquire). Appropriate image synthesis (rendering) techniques result in a realistic image formation for the virtual scenes, considering light sources, material, complex lens systems, and sensor properties, and can be used to evaluate and improve complex measuring systems and automated optical inspection (AOI) systems independent of a physical realization. In this paper, we describe an image generation pipeline for the evaluation and optimization of measuring and AOI systems, we provide an overview over suitable image synthesis methods and their characteristics, and we discuss the challenges for the design and specification of a given measuring situation in order to allow for a reliable simulation and validation.