Fraunhofer-Institut für Produktionsanlagen und Konstruktionstechnik IPK

Filters

7
7
7
Reset filters

Settings
Now showing 1 - 7 of 7
No Thumbnail Available
Publication

Towards anomaly detection: A feasibilty study for quality control in productions of nonwovens

2024 , Lehr, Jan , Pape, Martin , Nguyen Hoang, Viet , Philipps, Jan , Krüger, Jörg

In the face of the upcoming Corona pandemic in 2020, which continues to this day, adequate protection for all citizens has been very important and continues to be essential. An easy way to minimize the risk of infection in public, but poorly ventilated places, are FFP masks. The basic material from which FFP masks are made is nonwoven. The quality of the produced nonwoven is the basis for the correct function and thus the protection against infection. The present research work investigates methods of computer vision to detect contaminations and damages on the nonwoven. Both supervised and semi supervised methods are evaluated. For this work, an inspection system consisting of two separate acquisition systems was developed for image data acquisition. The first system is suitable for the visible wavelength and has a theoretical resolution of 2.4 μm per pixel. The second camera system is designed for the near infrared range and has a theoretical resolution of 5.5 μm per pixel. The acquisition system collects an image data set comprising 1,760 images with 920 images of defect-free nonwoven samples and 840 images of defective nonwoven samples. First, the wavelength range suitable for optical inspection of uncoated nonwoven samples is investigated. A further investigation dealt with the question of whether the reflected light or transmitted light method is more suitable for optical inspection. Finally, coated nonwoven is also inspected using the reflected light method. An investigation using the transmitted light method is not possible, as the material is almost non-transparent. Despite the small amount of data, very good results were achieved. Machine learning methods from the field of image processing are usually classified as deep learning. This means that the large network architectures require very large amounts of data in order to learn complex patterns. Publicly available datasets for method evaluation typically consist of over 1,000 images per class or defect. The nonwoven samples provided in this work and the resulting image database is about a factor of six smaller than is actually intended for the methods used. In this work it has been possible to achieve inspection accuracies of 97.5 %.

View
No Thumbnail Available
Publication

Limitations of Anomaly Detection: Beyond which Size Defects can be Reliably Recognized

2024 , Lehr, Jan , Pape, Martin , Philipps, Jan , Scholler, Felix , Krüger, Jörg

Anomaly detection is one of the most popular fields for computer vision in industrial applications. The idea of training machine learning only on defect-free objects saves enormous amounts of integration effort. The state of the art shows that current methods on public data sets (e.g. MVTec AD data set) have already solved the problem with AUROC segementations scores of more than 99 %. But how accurate are these methods really? In this paper, one current method from the field of supervised learning and anomaly detection is evaluated on two problems. Each problem contains a defect pattern that grows in 11 steps. This work shows that the defect is already reliably detected from a relative size of 0.03 % of the pixels in the image.

View
No Thumbnail Available
Publication

Development of a Fire Detection Based on the Analysis of Video Data by Means of Convolutional Neural Networks

2019 , Lehr, Jan , Gerson, Christian , Ajami, Mohamad , Krüger, Jörg

Convolutional Neural Networks (CNNs) have proven their worth in the field of image-based object recognition and localization. In the context of this work, a fire detector based on CNNs has been developed that detects fire by analyzing video sequences. The major additions of this work will primarily be realized through the use of temporal information contained in the video sequences depicting fire. In contrast to state of the art fire detectors, a large image database with 160,000 images with an even distribution of positive and negative samples has been created. To be able to compare image-based and video-based approaches as objectively as possible, different image-based CNNs will be trained under the same conditions as the video-based networks within the scope of this work. It will be shown that video-based networks offer an advantage over conventional image-based networks and therefore benefit from the temporal information of fire. We have achieved a prediction accuracy of 96.82%.

View
No Thumbnail Available
Publication

Insights of Anomaly Detection: How does Polluted Training Data Influence Performance?

2024 , Lehr, Jan , Pape, Martin , Günther, Samuel , Krüger, Jörg

Anomaly detection is one of the most popular fields for computer vision in industrial applications. The idea of training machine learning only on defect-free objects saves enormous amounts of integration effort. The state of the art shows that current methods on public data sets (e.g. MVTec AD data set [1]) have already solved the problem with AUROC segmentation scores of more than 99 %. In real-world applications training data is not as "clean" as in public data sets. This work investigates the changes in detection performance when outliers end up in the training data. For this purpose, the training data is enriched step by step with images of defective objects. The AUROC score and the anomaly score is used as a quality criterion for performance measurement. We show that state of the art methods can be very robust, but that in some scenarios a draw down of 15 percentage points is possible.

View
No Thumbnail Available
Publication

Automated Optical Inspection Using Anomaly Detection and Unsupervised Defect Clustering

2020 , Lehr, Jan , Sargsyan, Arlik , Pape, Martin , Philipps, Jan , Krüger, Jörg

Neural networks have proven to be extraordinarily successful in many computer vision applications. But the approaches used to train neural networks require large datasets of annotated images, which requires a solid amount of human time to prepare those datasets. To facilitate the adoption of machine learning based technologies in industrial computer vision applications, this paper presents a two-step unsupervised learning approach for anomaly detection with further defect clusterization. In the first stage, the defects are not explicitly learned, but are interpreted as an anomaly or novelty based on the dataset of defect-free samples. In a second stage, the anomalies detected in the first stage are clustered in unsupervised manner and classified into meaningful categories by experts with process knowledge (e.g. critical or non-critical defect). This paper presents a first small dataset containing one industrial object with a complex shape. The object is made of aluminiu m and is shown both free of defects and defective. Based on this, recommendations are given for an acquisition setup for a large, extensive dataset. Most of the existing papers are studying the approaches for uniform surface (texture) inspection. The specifics of this research is to identify defects on rigid bodies, which exhibit highly non uniform texture in the image. State of the art methods were evaluated and improved to increase the classification accuracy. With a fine-tuned ResNet-18 it was possible to achieve 100% accuracy for defective and defect-free images.

View
No Thumbnail Available
Publication

Image-Based Incremental Learning for Part Recognition of Used Automotive Cores in Reverse Logistics

2024 , Briese, Clemens , Chavan, Vivek Prabhakar , Schlüter, Marian , Lehr, Jan , Kröger, Ole

This paper presents a study on image-based incremental learning for part recognition of used automotive parts, also known as cores. The use of Machine Learning (ML) in the recognition of used parts has proven to be effective in suggesting Original Equipment Number (OEN) based on images and logistics data of a core. This leads to a four-eye process where the worker and ML interact through an assistance system. In reverse logistics, the spectrum of parts handled is constantly changing, making it difficult to have a "complete" image or sensor-based data set. The study focuses on the ramp-up phase of an ML implementation project in a real-world automotive core sorting station. There are two stations equipped with sensors such as RGB cameras. The sorted parts were acquired over a period of one year. Incremental learning was employed to cope with the growing dataset and the growing number of classes to be identified without retraining a model from scratch. Open source and state-of-the-art incremental ML learning methods such as POD-Net and Foster were tested against the common joint training approach used for most benchmarks in computer vision. The best-fitting open-source method for this problem was identified as POD-Net used with a self-supervised pretrained ResNet50. For the ramp-up of an ML-based core recognition a combination of incremental learning and joint training was found to be useful. It starts learning from a small number of digitized parts (14 classes), while maintaining a high recognition accuracy rate throughout the year, with a final class count of 100 (an increase of approx. 600%), which is a subset of a real application problem. The results of this study show that the proposed method is efficient, plastic, and energy-saving. Thus, it is a promising approach for the recognition of used automotive parts.

View
No Thumbnail Available
Publication

Classification of Similar Objects of Different Sizes Using a Reference Object by Means of Convolutional Neural Networks

2019 , Lehr, Jan , Schlüter, Marian , Krüger, Jörg

Part identification is relevant in many industrial applications, either for direct recognition of components or assemblies, either as a fully automated process or as an assistance system. Convolutional Neural Networks (CNNs) have proven their worth in image processing, especially in classification tasks. It therefore makes sense to use them for industrial applications. There are major problems with parts that look very similar and can only be identified by their size. In this paper we have considered a subset of screws that all conform to the same norm but are of different sizes. The implicit learning of the screw size is only possible if the images are taken in a fixed distance setup and larger screws are shown larger on the images. In this paper we show that CNNs are able to implicitly measure target objects with the help of reference objects and thus to integrate the object size into the learning process.

View