Robot Task Teaching System Enhanced by Utilizing Multimedia Technology

We propose a new concept called as "Information-sharing robot-task-teaching", which introduces multimedia technology into robot the task teaching system. Based on this concept, a multimedia communication pendant (MC pendant) system and a multi-modal teaching advisor (MTA) were developed. These systems provide a bi-directional communication channel between robot and operator, and transfer conscious, nonverbal information that can convey the operator's intention about the task. Experimental results show that these new teaching systems accurately convey the operator's intentions during robotic task programming and greatly improve operability in the teaching process compared with conventional pendant operation.