• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Scopus
  4. Multimodal RGB-D-T-scanning for interactive robot teaching
 
  • Details
  • Full
Options
2023
Conference Paper
Title

Multimodal RGB-D-T-scanning for interactive robot teaching

Abstract
In this paper, we introduce an interactive multimodal vision-based robot teaching method. Here, a multimodal 3D image (color (RGB), thermal (T) and point cloud (3D)) was used to capture the temperature, texture and geometry information required to analyze human action. By our method, we only need to move our finger on an object surface, and then the heat traces left by the finger on the object surface will be recorded by the multimodal 3D sensor. By analyzing the multimodal point cloud dynamically, the accurate finger trace on the object is recognized. A robot trajectory is computed using this finger trace.
Author(s)
Zhang, Yan
Notni, Gunther  
Fraunhofer-Institut für Angewandte Optik und Feinmechanik IOF  
Mainwork
Automated Visual Inspection and Machine Vision V  
Conference
Conference "Automated Visual Inspection and Machine Vision" 2023  
DOI
10.1117/12.2673406
Language
English
Fraunhofer-Institut für Angewandte Optik und Feinmechanik IOF  
Keyword(s)
  • interactive robot teaching

  • meshless method

  • Multimodal point cloud analysis

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024