Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Short-term change detection for UAV video

: Saur, Günter; Krüger, Wolfgang

Volltext urn:nbn:de:0011-n-2387754 (1.6 MByte PDF)
MD5 Fingerprint: a43b83d0f8b53f96e513daef8637a08b
Copyright 2012 Society of Photo-Optical Instrumentation Engineers. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
Erstellt am: 3.5.2013

Bruzzone, L. ; Society of Photo-Optical Instrumentation Engineers -SPIE-, Bellingham/Wash.:
Image and Signal Processing for Remote Sensing XVIII : Edinburgh 2012, 24.09.2012, Edinburgh, United Kingdom
Bellingham, WA: SPIE, 2012 (Proceedings of SPIE 8537)
ISBN: 978-0-8194-9277-7
Paper 85370R
Conference "Image and Signal Processing for Remote Sensing" <18, 2012, Edinburgh>
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IOSB ()
change detection; video exploitation; UAV; cross-correlation; image differencing; short-term change

In the last years, there has been an increased use of unmanned aerial vehicles (UAV) for video reconnaissance and surveillance. An important application in this context is change detection in UAV video data. Here we address short-term change detection, in which the time between observations ranges from several minutes to a few hours. We distinguish this task from video motion detection (shorter time scale) and from long term change detection, based on time series of still images taken between several days, weeks, or even years. Examples for relevant changes we are looking for are recently parked or moved vehicles. As a pre-requisite, a precise image-to-image registration is needed. Images are selected on the basis of the geo-coordinates of the sensor's footprint and with respect to a certain minimal overlap. The automatic image based fine-registration adjusts the image pair to a common geometry by using a robust matching approach to handle outliers. The change detection algorithm has to distinguish between relevant and non-relevant changes. Examples for non-relevant changes are stereo disparity at 3D structures of the scene, changed length of shadows, and compression or transmission artifacts. To detect changes in image pairs we analyzed image differencing, local image correlation, and a transformation-based approach (multivariate alteration detection). As input we used color and gradient magnitude images. To cope with local misalignment of image structures we extended the approaches by a local neighborhood search. The algorithms are applied to several examples covering both urban and rural scenes. The local neighborhood search in combination with intensity and gradient magnitude differencing clearly improved the results. Extended image differencing performed better than both the correlation based approach and the multivariate alternation detection. The algorithms are adapted to be used in semi-automatic workflows for the ABUL video exploitation system of Fraunhofer IOSB, see Heinze et. al. 2010.1 In a further step we plan to incorporate more information from the video sequences to the change detection input images, e.g., by image enhancement or by along-track stereo which are available in the ABUL system.