Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Deep Workpiece Region Segmentation for Bin Picking

: Khalid, Muhammad Usman; Hager, Janik; Kraus, Werner; Huber, Marco; Toussaint, Marc


Institute of Electrical and Electronics Engineers -IEEE-; IEEE Robotics and Automation Society:
IEEE 15th International Conference on Automation Science and Engineering, CASE 2019 : August 22-26, 2019, Vancouver, Canada
Piscataway, NJ: IEEE, 2019
ISBN: 978-1-7281-0355-6
ISBN: 978-1-7281-0356-3
ISBN: 978-1-7281-0357-0
International Conference on Automation Science and Engineering (CASE) <15, 2019, Vancouver>
Fraunhofer IPA ()
Griff in die Kiste; Künstliche Intelligenz; neuronales Netz; neuronales Netzwerk; Segmentierung; Segmentierung (Bildverarbeitung)

For most industrial bin picking solutions, the pose of a workpiece is localized by matching a CAD model to point cloud obtained from 3D sensor. Distinguishing flat workpieces from bottom of the bin in point cloud imposes challenges in the localization of workpieces that lead to wrong or phantom detections. In this paper, we propose a framework that solves this problem by automatically segmenting workpiece regions from non-workpiece regions in a point cloud data. It is done in real time by applying a fully convolutional neural network trained on both simulated and real data. The real data has been labelled by our novel technique which automatically generates ground truth labels for real point clouds. Along with real time workpiece segmentation, our framework also helps in improving the number of detected workpieces and estimating the correct object poses. Moreover, it decreases the computation time by approximately 1s due to a reduction of the search space for the object pose estimation.