Gesture based robot programming using process knowledge

This paper is a work in progress report on a novel system for intuitive gesture based robot programming. The major contribution is the addition of an expert system into the robot programming process. The expert system uses static knowledge, such as seam types, and dynamic knowledge to reason about the intended process. The dynamic knowledge holds information about the environment and is derived from sensor data. The paper outlines the required components and the current state of development of a prototype system. An example of the inference process is given for a robot laser welding application.