Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

High-performance image deinterlacing using optical flow and artifact post-processing on GPU/CPU for surveillance and reconnaissance tasks

: Müller, Thomas


Henry, Daniel J. (Ed.) ; Society of Photo-Optical Instrumentation Engineers -SPIE-, Bellingham/Wash.:
Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications XIII : 18-19 April 2016, Baltimore, Maryland, United States
Bellingham, WA: SPIE, 2016 (Proceedings of SPIE 9828)
ISBN: 9781510600690
Paper 98280J, 15 pp.
Conference "Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications" <13, 2016, Baltimore/Md.>
Conference Paper
Fraunhofer IOSB ()
deinterlacing; computer vision pre-processing; optical flow; artifact correction; surveillance; reconnaissance

The necessity to process interlaced images in surveillance, reconnaissance, or further computer vision areas should be a topic of the past. But, for different reasons, it is not. So, there are situations in practice, in which interlaced images have to be processed. Since a lot of algorithms strongly degrade when working with such images directly, a usual method is to double or interpolate image lines in order to discard one of the two enclosed image frames. This is efficient but leads to weak results, in which half of the original information is lost. Alternatively, a lot of valuable computation time has to be spent to solve the highly complex motion compensation task in order to improve the results significantly. In this paper, an efficient algorithm is presented to solve this dilemma. First, the algorithm solves the complex 2-D mapping problem using the best state-of-the art optical flow method that could be found for this purpose. But, of course, for different physical reasons there are regions which cannot properly be handled by optical flow by itself. Therefore, an efficient post-processing method detects and removes remaining artifacts afterwards, which is the main contribution of this paper. This method is based on color interpolation incorporating local image structure. The presented results document the overall performance of the approach with respect to obtained image quality and calculation time. The method is easy to implement and offers a valuable pre-processing for a lot of computer vision tasks.