Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Software environment for holistic vision-system-on-chip programming

: Reichel, Peter; Döge, Jens; Peter, Nico; Hoppe, Christoph; Reichel, Andreas; Schneider, Peter


Darmont, A. ; Society for Imaging Science and Technology -IS&T-:
IS&T International Symposium on Electronic Imaging 2016. Science and Technology. Proceedings : Image Sensors and Imaging Systems 2016, 14-18 February 2016, San Francisco, California
Springfield/Va.: IS&T, 2016
8 S.
International Symposium on Electronic Imaging <2016, San Francisco/Calif.>
Fraunhofer IIS, Institutsteil Entwurfsautomatisierung (EAS) ()

Image sensors with integrated signal processing – so called “Vision Chips” – allow for execution of computationally intensive processing steps directly after image acquisition. Programmable systems, whose functional units may be utilized in a flexible manner for various image processing tasks, require a flexible, modular toolchain. A programming environment, consisting of an assembler supporting ASIP-based (Application Specific Instruction Set Processor) control units and a Python translator supporting a subset of the Python programming language, will be presented. Library elements are used to further abstract the behavior of the underlying Vision-System-on-Chip (VSoC). For a concrete task, both VSoC-internal and conventional processing steps can be implemented within the same project. When combined with established libraries such as OpenCV, VSoC-internal processing close to the sensor becomes a powerful tool for holistic vision task design.