Dr.-Ing.

Gruna, Robin

Filters
Reset filters

Settings
Now showing 1 - 10 of 40
  • Publication
    Particle-Specific Deflection Windows for Optical Sorting by Uncertainty Quantification
    ( 2024)
    Reith-Braun, Marcel
    ;
    Liang, Kevin
    ;
    Pfaff, Florian
    ;
    Maier, Georg
    ;
    Gruna, Robin
    ;
    Bauer, Albert
    ;
    Kruggel-Emden, Harald
    ;
    Längle, Thomas
    ;
    Beyerer, Jürgen
    ;
    Hanebeck, Uwe D.
    In current state of the art sensor-based sorting systems, the length of the deflection windows, i.e., the period of nozzle activation and the number of nozzles to be activated, is commonly determined solely by the size of the particles. However, this comes at the cost of the sorting process not accounting for model discrepancies between actual and presumed particle motion, as well as for situations where the available information does not allow for precise determination of nozzle activations. To achieve a desired sorting accuracy, in practice, one is therefore usually forced to enlarge the deflection window to a certain degree, which increases the number of falsely co-deflected particles and compressed air consumption. In this paper, we propose incorporating the uncertainty of the prediction of particle motion of each individual particle into the determination of the deflection windows. The method is based on the predictive tracking approach for optical sorting, which tracks the particles while they move toward the nozzle array based on images of an area-scan camera. Given the extracted motion information from the tracking, we propose an approximation for the distribution of arrival time and location of the particle at the nozzle array assuming nearly constant-velocity or nearly constantacceleration particle motion behavior. By evaluating the quantile function of both distributions, we obtain a confidence interval for the arrival time and location based on prediction uncertainty, which we then combine with the particle size to form the final deflection window. We apply our method to a real sorting task using a pilot-scale chute sorter. Our results obtained from extensive sorting trials show that sorting accuracies can be remarkably improved compared with state-of-the-art industrial sorters and enhanced even further compared with predictive tracking while having the potential to reduce compressed air consumption.
  • Publication
    A survey of the state of the art in sensor-based sorting technology and research
    ( 2024)
    Maier, Georg
    ;
    Gruna, Robin
    ;
    Längle, Thomas
    ;
    Beyerer, Jürgen
    Sensor-based sorting describes a family of systems that enable the removal of individual objects from a material stream. The technology is widely used in various industries such as agriculture, food, mining, and recycling. Examples of sorting tasks include the removal of fungus-infested grains, the enrichment of copper content in copper mining or the sorting of plastic waste according to the type of plastic. Sorting decisions are made based on information acquired by one or more sensors. A particular strength of the technology is the flexibility in sorting decisions, which is achieved by using various sensors and programming the data analysis. However, a comprehensive understanding of the process is necessary for the development of new sorting systems that can address previously unresolved tasks. This survey is aimed at innovative researchers and practitioners who are unfamiliar with sensor-based sorting or have only encountered certain aspects of the overall process. The references provided serve as starting points for further exploration of specific topics.
  • Publication
    Benchmarking a DEM‐CFD Model of an Optical Belt Sorter by Experimental Comparison
    ( 2023)
    Bauer, Albert
    ;
    Maier, Georg
    ;
    Reith-Braun, Marcel
    ;
    Kruggel-Emden, Harald
    ;
    Pfaff, Florian
    ;
    Gruna, Robin
    ;
    Hanebeck, Uwe
    ;
    Längle, Thomas
    A DEM-CFD (discrete element method - computational fluid dynamics) model of an optical belt sorter was extensively compared with experiments of a laboratory-scale sorter to assess the model's accuracy. Brick and sand-lime brick were considered as materials. First, the transport characteristics on the conveyor belt, involving mass flow, lateral particle distribution and proximity, were compared. Second, sorting results were benchmarked for varying mixture proportions at differing mass flows. It was found that the numerical model is able to reproduce the experimental results with high accuracy.
  • Publication
    Development of multilevel monitoring systems for the identification of phytoplasma diseases in German viticultural areas
    ( 2023)
    Jarausch, Barbara
    ;
    Alisaac, Elias
    ;
    Schumacher, Petra
    ;
    Gauweiler, Pascal
    ;
    Gruna, Robin
    ;
    Zabawa, Laura
    ;
    Klingbeil, Lasse
    ;
    Rechkemmer, Sonja
    ;
    Jarausch, Wolfgang
    ;
    Maixner, Michael
    ;
    Kicherer, Anna
    "Flavescence dorée" (FD) and "bois noir" (BN) are the most important phytoplasma diseases of grapevine. While BN is widespread in German winegrowing regions, only one single grapevine plant infected with FD phytoplasma has been reported and eradicated in 2020. Although the main vector of FD, Scaphoideus titanus, is not present in Germany, the FD phytoplasma is classified as quarantine pest because of its epidemic potential and a systematic monitoring of the disease and the vector is mandatory in Germany. Furthermore, a non-epidemic strain Palatinate grapevine yellows (PGY), with the same symptomatology as FD and BN is present in Germany. For large scale monitoring digital multilevel monitoring systems for grapevine yellows (GY) are being developed. Reference plots with infection by either BN or PGY in risk zones in southwestern Germany and Württemberg have been visually monitored and symptomatic grapevines were analysed by molecular means. In parallel, the same samples were examined with different sensor-based methods to define a correlation between phytoplasma presence and specific spectral signatures. A spectral distinction to similar symptoms due to virus infection, insect damage, and nutritional deficiencies was investigated for the system validation.
  • Publication
    Multi-Modal Image Acquisition for AI-Based Bulky Waste Sorting (Incl. Terahertz Synthetic Aperture Radar)
    ( 2023)
    Cibiraite-Lukenskiene, Dovile
    ;
    Gundacker, Dominik
    ;
    Bihler, M.
    ;
    Heizmann, M.
    ;
    Schlüter, Friedrich
    ;
    Aderhold, Jochen
    ;
    Roming, Lukas
    ;
    Gruna, Robin
    ;
    Jonuscheit, Joachim
    ;
    Friederich, Fabian
    This work presents the results of the initial acquisition of a multi-modal dataset that will be utilized to train and test a neural network for wood sorting. The aim of the project is to improve wood recycling from bulky waste by using four complementary sensing systems: visual, infrared, terahertz, and thermography. The four systems were combined to capture 57 multi-modal images of bulky waste samples moving on the conveyor belt at a speed of 10 cm/s. Early fusion results on THz show 0.77 accuracy, whereas the best multi-modal data fusion accuracy equals 0.921.
  • Publication
    Improving Accuracy of Optical Sorters Using Closed-Loop Control of Material Recirculation
    ( 2023)
    Vieth, Jonathan
    ;
    Reith-Braun, Marcel
    ;
    Bauer, Albert
    ;
    Pfaff, Florian
    ;
    Maier, Georg
    ;
    Gruna, Robin
    ;
    Längle, Thomas
    ;
    Kruggel-Emden, Harald
    ;
    Hanebeck, Uwe D.
    Optical sorting is a key technology for the circular economy and is widely applied in the food, mineral, and recycling industries. Despite its widespread use, one typically resorts to expensive means of adjusting the accuracy, e.g., by reducing the mass flow or changing mechanical or software parameters, which typically requires manual tuning in a lengthy, iterative process. To circumvent these drawbacks, we propose a new layout for optical sorters along with a controller that allows re-feeding of controlled fractions of the sorted mass flows. To this end, we build a dynamic model of the sorter, analyze its static behavior, and show how material recirculation affects the sorting accuracy. Furthermore, we build a model predictive controller (MPC) employing the model and evaluate the closed-loop sorting system using a coupled discrete element–computational fluid dynamics (DEM-CFD) simulation, demonstrating improved accuracy.
  • Publication
    GridSort: Image-based Optical Bulk Material Sorting Using Convolutional LSTMs
    ( 2023)
    Reith-Braun, Marcel
    ;
    Bauer, Albert
    ;
    Staab, Maximilian
    ;
    Pfaff, Florian
    ;
    Maier, Georg
    ;
    Gruna, Robin
    ;
    Längle, Thomas
    ;
    Beyerer, Jürgen
    ;
    Kruggel-Emden, Harald
    ;
    Hanebeck, Uwe D.
    Optical sorters separate particles of different classes by first detecting them while they are transported, e.g., on a conveyor belt, and subsequently bursting out particles of undesired classes using compressed air nozzles. Currently, the most promising results are achieved by predictive tracking, a multitarget tracking approach based on extracted midpoints from area-scan camera images that analyzes the particles’ motion and activates the nozzles accordingly. However, predictive tracking requires expert knowledge for setup and preceding object detection. Moreover, particle shapes are only considered implicitly, and the need to solve an association problem rises the computational complexity of the algorithm. In this paper, we present GridSort, an image-based approach that forecasts the scene at the nozzle array using a convolutional long short-term memory neural network and subsequently extracts nozzle activations, thus circumventing the aforementioned weaknesses. We show how GridSort can be trained in an unsupervised fashion and evaluate it using a coupled discrete element–computational fluid dynamics simulation of an optical sorter. We compare our method with predictive tracking in terms of sorting accuracy and demonstrate that it is an easy-to-apply alternative while achieving state-of-the-art results.
  • Publication
    Determination of Sugars and Acids in Grape Must Using Miniaturized Near-Infrared Spectroscopy
    ( 2023)
    Cornehl, Lucie
    ;
    Krause, Julius
    ;
    Zheng, Xiaorong
    ;
    Gauweiler, Pascal
    ;
    Schwander, Florian
    ;
    Töpfer, Reinhard
    ;
    Gruna, Robin
    ;
    Kicherer, Anna
    An automatic determination of grape must ingredients during the harvesting process would support cellar logistics and enables an early termination of the harvest if quality parameters are not met. One of the most important quality-determining characteristics of grape must is its sugar and acid content. Among others, the sugars in particular determine the quality of the must and wine. Chiefly in wine cooperatives, in which a third of all German winegrowers are organized, these quality characteristics serve as the basis for payment. They are acquired upon delivery at the cellar of the cooperative or the winery and result in the acceptance or rejection of grapes and must. The whole process is very time-consuming and expensive, and sometimes grapes that do not meet the quality requirements for sweetness, acidity, or healthiness are destroyed or not used at all, which leads to economic loss. Near-infrared spectroscopy is now a widely used technique to detect a wide variety of ingredients in biological samples. In this study, a miniaturized semi-automated prototype apparatus with a near-infrared sensor and a flow cell was used to acquire spectra (1100 nm to 1350 nm) of grape must at defined temperatures. Data of must samples from four different red and white Vitis vinifera (L.) varieties were recorded throughout the whole growing season of 2021 in Rhineland Palatinate, Germany. Each sample consisted of 100 randomly sampled berries from the entire vineyard. The contents of the main sugars (glucose and fructose) and acids (malic acid and tartaric acid) were determined with high-performance liquid chromatography. Chemometric methods, using partial least-square regression and leave-one-out cross-validation, provided good estimates of both sugars (RMSEP = 6.06 g/L, R2 = 89.26%), as well as malic acid (RMSEP = 1.22 g/L, R2 = 91.10%). The coefficient of determination (R2) was comparable for glucose and fructose with 89.45% compared to 89.08%, respectively. Although tartaric acid was predictable for only two of the four varieties using near-infrared spectroscopy, calibration and validation for malic acid were accurate for all varieties in an equal extent like the sugars. These high prediction accuracies for the main quality determining grape must ingredients using this miniaturized prototype apparatus might enable an installation on a grape harvester in the future.
  • Publication
    Multi-sensor data fusion using deep learning for bulky waste image classification
    ( 2023)
    Bihler, Manuel
    ;
    Roming, Lukas
    ;
    Jiang, Yifan
    ;
    Afifi, Ahmed J.
    ;
    Aderhold, Jochen
    ;
    Cibiraite-Lukenskiene, Dovile
    ;
    Lorenz, Sandra
    ;
    Gloaguen, Richard
    ;
    Gruna, Robin
    ;
    Heizmann, Michael
    Deep learning techniques are commonly utilized to tackle various computer vision problems, including recognition, segmentation, and classification from RGB images. With the availability of a diverse range of sensors, industry-specific datasets are acquired to address specific challenges. These collected datasets have varied modalities, indicating that the images possess distinct channel numbers and pixel values that have different interpretations. Implementing deep learning methods to attain optimal outcomes on such multimodal data is a complicated procedure. To enhance the performance of classification tasks in this scenario, one feasible approach is to employ a data fusion technique. Data fusion aims to use all the available information from all sensors and integrate them to obtain an optimal outcome. This paper investigates early fusion, intermediate fusion, and late fusion in deep learning models for bulky waste image classification. For training and evaluation of the models, a multimodal dataset is used. The dataset consists of RGB, hyperspectral Near Infrared (NIR), Thermography, and Terahertz images of bulky waste. The results of this work show that multimodal sensor fusion can enhance classification accuracy compared to a single-sensor approach for the used dataset. Hereby, late fusion performed the best with an accuracy of 0.921 compared to intermediate and early fusion, on our test data.
  • Publication
    Towards a feed material adaptive optical belt sorter: A simulation study utilizing a DEM-CFD approach
    ( 2022-09-09)
    Bauer, Albert
    ;
    Maier, Georg
    ;
    Reith-Braun, Marcel
    ;
    Kruggel-Emden, Harald
    ;
    Pfaff, Florian
    ;
    Gruna, Robin
    ;
    Hanebeck, Uwe
    ;
    Längle, Thomas
    In this investigation, a DEM-CFD model of an optical belt sorter is modified to become adaptive to varying belt speeds. For that, the positions and orientations of the nozzle bar and collecting containers are rearranged. Also, the duration of nozzle activation and optimal position of particle ejection are adjusted. For the derivation of optimal velocity-dependent parameters, a two-dimensional model is derived and optimized as a pre-processing step. The derived parameters are applied to the three-dimensional DEM-CFD model. Two optically distinguishable types of demolition waste materials are considered. All conveyor belt velocities are investigated with instantaneously and lagged activated nozzles, which represent fast and realistic triggered nozzle activations. The application of optimized sorting setups shows promising sorting results for a broad range of conveyor belt velocities. The obtained results are discussed in terms of their feasibility in being applied to real optical belt sorters.