• English
  • Deutsch
  • Log In
    Password Login
    or
  • Research Outputs
  • Projects
  • Researchers
  • Institutes
  • Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Konferenzschrift
  4. Deep learning-based video analysis pipeline for person detection and re-identification in aerial imagery
 
  • Details
  • Full
Options
2021
Conference Paper
Titel

Deep learning-based video analysis pipeline for person detection and re-identification in aerial imagery

Abstract
In addition to conventional camera networks, the deployment of drones allows for increased flexibility in surveillance tasks. Key components in modern analysis systems required to quickly assess a large amount of recorded aerial video data are the detection, tracking, and re-identification of persons. Each of the components is influenced by the characteristics of the aerial data and must be robust against challenges such as different flight altitudes and varying acquisition views and angles. In this work, we introduce a fast and efficient framework for person search which is specifically tailored to the characteristics of aerial data recorded by drones. In contrast to most of the works on person search and re-identification, we incorporate a tracking technique to add relevant context information about persons' movements to the retrieval results. In general, we focus on the three pipeline stages person detection, tracking, and re-identification as itself as well as the interplay between the components. For this, we adapt current state-of-the-art approaches for detection to the specific characteristics of aerial data and speed up the inference time by several modifications. Next, we apply a deep learning-based tracking approach, namely Deep SORT, to generate person tracks based on the detections. For the re-identification stage, we employ a lightweight re-identification model which is applied to generate features for both tracking and re-identification. To demonstrate the suitability of our proposed video analysis pipeline, we evaluate each component as well as their interplay on the P-DESTRE dataset.
Author(s)
Specker, Andreas
Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB
Moritz, Lennart
Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB
Sommer, Lars
Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB
Hauptwerk
Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies V
Konferenz
Conference "Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies" 2021
Thumbnail Image
DOI
10.1117/12.2600109
Language
English
google-scholar
Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung IOSB
Tags
  • person search

  • re-identification

  • detection

  • aerial

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Send Feedback
© 2022