Now showing 1 - 9 of 9
  • Publication
    Particle-Specific Deflection Windows for Optical Sorting by Uncertainty Quantification
    ( 2024)
    Reith-Braun, Marcel
    ;
    Liang, Kevin
    ;
    Pfaff, Florian
    ;
    ; ;
    Bauer, Albert
    ;
    Kruggel-Emden, Harald
    ;
    ; ;
    Hanebeck, Uwe D.
    In current state of the art sensor-based sorting systems, the length of the deflection windows, i.e., the period of nozzle activation and the number of nozzles to be activated, is commonly determined solely by the size of the particles. However, this comes at the cost of the sorting process not accounting for model discrepancies between actual and presumed particle motion, as well as for situations where the available information does not allow for precise determination of nozzle activations. To achieve a desired sorting accuracy, in practice, one is therefore usually forced to enlarge the deflection window to a certain degree, which increases the number of falsely co-deflected particles and compressed air consumption. In this paper, we propose incorporating the uncertainty of the prediction of particle motion of each individual particle into the determination of the deflection windows. The method is based on the predictive tracking approach for optical sorting, which tracks the particles while they move toward the nozzle array based on images of an area-scan camera. Given the extracted motion information from the tracking, we propose an approximation for the distribution of arrival time and location of the particle at the nozzle array assuming nearly constant-velocity or nearly constantacceleration particle motion behavior. By evaluating the quantile function of both distributions, we obtain a confidence interval for the arrival time and location based on prediction uncertainty, which we then combine with the particle size to form the final deflection window. We apply our method to a real sorting task using a pilot-scale chute sorter. Our results obtained from extensive sorting trials show that sorting accuracies can be remarkably improved compared with state-of-the-art industrial sorters and enhanced even further compared with predictive tracking while having the potential to reduce compressed air consumption.
  • Publication
    GridSort: Image-based Optical Bulk Material Sorting Using Convolutional LSTMs
    ( 2023)
    Reith-Braun, Marcel
    ;
    Bauer, Albert
    ;
    Staab, Maximilian
    ;
    Pfaff, Florian
    ;
    ; ; ; ;
    Kruggel-Emden, Harald
    ;
    Hanebeck, Uwe D.
    Optical sorters separate particles of different classes by first detecting them while they are transported, e.g., on a conveyor belt, and subsequently bursting out particles of undesired classes using compressed air nozzles. Currently, the most promising results are achieved by predictive tracking, a multitarget tracking approach based on extracted midpoints from area-scan camera images that analyzes the particles’ motion and activates the nozzles accordingly. However, predictive tracking requires expert knowledge for setup and preceding object detection. Moreover, particle shapes are only considered implicitly, and the need to solve an association problem rises the computational complexity of the algorithm. In this paper, we present GridSort, an image-based approach that forecasts the scene at the nozzle array using a convolutional long short-term memory neural network and subsequently extracts nozzle activations, thus circumventing the aforementioned weaknesses. We show how GridSort can be trained in an unsupervised fashion and evaluate it using a coupled discrete element–computational fluid dynamics simulation of an optical sorter. We compare our method with predictive tracking in terms of sorting accuracy and demonstrate that it is an easy-to-apply alternative while achieving state-of-the-art results.
  • Publication
    Benchmarking a DEM‐CFD Model of an Optical Belt Sorter by Experimental Comparison
    ( 2023)
    Bauer, Albert
    ;
    ;
    Reith-Braun, Marcel
    ;
    Kruggel-Emden, Harald
    ;
    Pfaff, Florian
    ;
    ;
    Hanebeck, Uwe
    ;
    A DEM-CFD (discrete element method - computational fluid dynamics) model of an optical belt sorter was extensively compared with experiments of a laboratory-scale sorter to assess the model's accuracy. Brick and sand-lime brick were considered as materials. First, the transport characteristics on the conveyor belt, involving mass flow, lateral particle distribution and proximity, were compared. Second, sorting results were benchmarked for varying mixture proportions at differing mass flows. It was found that the numerical model is able to reproduce the experimental results with high accuracy.
  • Publication
    Improving Accuracy of Optical Sorters Using Closed-Loop Control of Material Recirculation
    ( 2023)
    Vieth, Jonathan
    ;
    Reith-Braun, Marcel
    ;
    Bauer, Albert
    ;
    Pfaff, Florian
    ;
    ; ; ;
    Kruggel-Emden, Harald
    ;
    Hanebeck, Uwe D.
    Optical sorting is a key technology for the circular economy and is widely applied in the food, mineral, and recycling industries. Despite its widespread use, one typically resorts to expensive means of adjusting the accuracy, e.g., by reducing the mass flow or changing mechanical or software parameters, which typically requires manual tuning in a lengthy, iterative process. To circumvent these drawbacks, we propose a new layout for optical sorters along with a controller that allows re-feeding of controlled fractions of the sorted mass flows. To this end, we build a dynamic model of the sorter, analyze its static behavior, and show how material recirculation affects the sorting accuracy. Furthermore, we build a model predictive controller (MPC) employing the model and evaluate the closed-loop sorting system using a coupled discrete element–computational fluid dynamics (DEM-CFD) simulation, demonstrating improved accuracy.
  • Publication
    Towards a feed material adaptive optical belt sorter: A simulation study utilizing a DEM-CFD approach
    ( 2022-09-09)
    Bauer, Albert
    ;
    ;
    Reith-Braun, Marcel
    ;
    Kruggel-Emden, Harald
    ;
    Pfaff, Florian
    ;
    ;
    Hanebeck, Uwe
    ;
    In this investigation, a DEM-CFD model of an optical belt sorter is modified to become adaptive to varying belt speeds. For that, the positions and orientations of the nozzle bar and collecting containers are rearranged. Also, the duration of nozzle activation and optimal position of particle ejection are adjusted. For the derivation of optimal velocity-dependent parameters, a two-dimensional model is derived and optimized as a pre-processing step. The derived parameters are applied to the three-dimensional DEM-CFD model. Two optically distinguishable types of demolition waste materials are considered. All conveyor belt velocities are investigated with instantaneously and lagged activated nozzles, which represent fast and realistic triggered nozzle activations. The application of optimized sorting setups shows promising sorting results for a broad range of conveyor belt velocities. The obtained results are discussed in terms of their feasibility in being applied to real optical belt sorters.
  • Publication
    Mixture of Experts of Neural Networks and Kalman Filters for Optical Belt Sorting
    ( 2022)
    Thumm, Jakob
    ;
    Reith-Braun, Marcel
    ;
    Pfaff, Florian
    ;
    Hanebeck, Uwe D.
    ;
    Flitter, Merle
    ;
    ; ; ;
    Bauer, Albert
    ;
    Kruggel-Emden, Harald
    In optical sorting of bulk material, the composition of particles may frequently change. State-of-the-art sorting approaches rely on tuning physical models of the particle motion. The aim of this work is to increase the prediction accuracy in complex, fast-changing sorting scenarios with data-driven approaches. We propose two neural network (NN) experts for accurate prediction of a priori known particle types. To handle the large variety of particle types that can occur in real-world sorting scenarios, we introduce a simple but effective mixture of experts approach that combines NNs with hand-crafted motion models. Our new method not only improves the prediction accuracy for bulk material consisting of many particle classes, but also proves to be very adaptive and robust to new particle types.
  • Publication
    Experimental Evaluation of a Novel Sensor-Based Sorting Approach Featuring Predictive Real-Time Multiobject Tracking
    ( 2021) ;
    Pfaff, Florian
    ;
    Pieper, Christoph
    ;
    ;
    Noack, Benjamin
    ;
    Kruggel-Emden, Harald
    ;
    ;
    Hanebeck, Uwe D.
    ;
    Wirtz, Siegmar
    ;
    Scherer, Viktor
    ;
    Sensor-based sorting is a machine vision application that has found industrial application in various fields. An accept-or-reject task is executed by separating a material stream into two fractions. Current systems use line-scanning sensors, which is convenient as the material is perceived during transportation. However, line-scanning sensors yield a single observation of each object and no information about their movement. Due to a delay between localization and separation, assumptions regarding the location and point in time for separation need to be made based on the prior localization. Hence, it is necessary to ensure that all objects are transported at uniform velocities. This is often a complex and costly solution. In this paper, we propose a new method for reliably separating particles at non-uniform velocities. The problem is transferred from a mechanical to an algorithmic level. Our novel advanced image processing approach includes equipping the sorter with an area-scan camera in combination with a real-time multiobject tracking system, which enables predictions of the location of individual objects for separation. For the experimental validation of our approach, we present a modular sorting system, which allows comparing sorting results using a line-scan and area-scan camera. Results show that our approach performs reliable separation and hence increases sorting efficiency.
  • Patent
    Verfahren und Vorrichtung zur Bestimmung zumindest einer mechanischen Eigenschaft zumindest eines Objektes
    ( 2019) ;
    Noack, Beniamin
    ;
    Pfaff, Florian
    ;
    Hanebeck, Uwe
    ;
    ;
    Die Erfindung betrifft ein Verfahren und eine Vorrichtung zum Bestimmen zumindest einer mechanischen Eigenschaft zumindest eines Objektes, wobei das zumindest eine Objekt zumindest einer Wechselwirkung unterworfen wird, die einen Bewegungszustand des zumindest einen Objektes beeinflusst,wobei die zumindest eine Wechselwirkung so gewählt ist, dass der durch die Wechselwirkung bewirkte Bewegungszustand eine Funktion der zumindest einen mechanischen Eigenschaft ist,wobei das zumindest eine Objekt mit zumindest einer Kamera beobachtet wird,wobei aus von der zumindest einen Kamera aufgenommenen Bildern der Bewegungszustand bestimmt wirdund wobei aus dem so bestimmten Bewegungszustand die zumindest eine mechanische Eigenschaft des zumindest einen Objektes bestimmt wird.
  • Patent
    Verfahren und Vorrichtung zur Bestimmung zumindest einer mechanischen Eigenschaft zumindest eines Objektes
    ( 2019) ;
    Hanebeck, Uwe
    ;
    ; ;
    Noack, Benjamin
    ;
    Pfaff, Florian
    Die Erfindung betrifft ein Verfahren und eine Vorrichtung zum Bestimmen zumindest einer mechanischen Eigenschaft zumindest eines Objektes, wobei das zumindest eine Objekt zumindest einer Wechselwirkung unterworfen wird, die einen Bewegungszustand des zumindest einen Objektes beeinflusst,wobei die zumindest eine Wechselwirkung so gewählt ist, dass der durch die Wechselwirkung bewirkte Bewegungszustand eine Funktion der zumindest einen mechanischen Eigenschaft ist,wobei das zumindest eine Objekt mit zumindest einer Kamera beobachtet wird,wobei aus von der zumindest einen Kamera aufgenommenen Bildern der Bewegungszustand bestimmt wirdund wobei aus dem so bestimmten Bewegungszustand die zumindest eine mechanische Eigenschaft des zumindest einen Objektes bestimmt wird.