Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Identification of spatially corresponding imagery using content-based image retrieval in the context of UAS video exploitation

: Brüstle, Stefan; Manger, Daniel; Mück, Klaus; Heinze, Norbert

Postprint urn:nbn:de:0011-n-3019323 (686 KByte PDF)
MD5 Fingerprint: d8a664f403adefb22bb0bb657d384140
Copyright Society of Photo-Optical Instrumentation Engineers. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
Erstellt am: 31.3.2015

Henry, D.J. ; Society of Photo-Optical Instrumentation Engineers -SPIE-, Bellingham/Wash.:
Airborne intelligence, surveillance, reconnaissance (ISR) systems and applications XI : 7 - 8 May 2014, Baltimore, Maryland, United States
Bellingham, WA: SPIE, 2014 (Proceedings of SPIE 9076)
ISBN: 978-1-62841-013-6
Paper 907603, 10 S.
Conference "Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications" <11, 2014, Baltimore/Md.>
Konferenzbeitrag, Elektronische Publikation
Fraunhofer IOSB ()
airborne intelligence; surveillance; reconnaissance; ISR; content-based image retrieval; UAS

For many tasks in the fields of reconnaissance and surveillance it is important to know the spatial location represented by the imagery to be exploited. A task involving the assessment of changes, e.g. the appearance or disappearance of an object of interest at a certain location, can typically not be accomplished without spatial location information associated with the imagery. Often, such georeferenced imagery is stored in an archive enabling the user to query for the data with respect to its spatial location. Thus, the user is able to effectively find spatially corresponding imagery to be used for change detection tasks. In the field of exploitation of video taken from unmanned aerial systems (UAS), spatial location data is usually acquired using a GPS receiver, together with an INS device providing the sensor orientation, both integrated in the UAS. If during a flight valid GPS data becomes unavailable for a period of time, e.g. due to sensor malfunction, transmission problems or jamming, the imagery gathered during that time is not applicable for change detection tasks based merely on its georeference. Furthermore, GPS and INS inaccuracy together with a potentially poor knowledge of ground elevation can also render location information inapplicable. On the other hand, change detection tasks can be hard to accomplish even if imagery is well georeferenced as a result of occlusions within the imagery, due to e.g. clouds or fog, or image artefacts, due to e.g. transmission problems. In these cases a merely georeference based approach to find spatially corresponding imagery can also be inapplicable. In this paper, we present a search method based on the content of the images to find imagery spatially corresponding to given imagery independent from georeference quality. Using methods from content-based image retrieval, we build an image database which allows for querying even large imagery archives efficiently. We further evaluate the benefits of this method in the context of a video exploitation workflow on the basis of its integration into our video archive system.