The aim of the project is to enable non-experts with the opportunity to easily teach robots a complex assembly process using natural communication methods. In order for robot systems to learn from a non-expert user, the robot system should first understand the user’s intention. In this project, human intentions are understood both through verbal communication and by observing human actions. In order to recognize human intentions through voice communication, PROFACTOR will work together with LIFEtool on the development of a new communication interface for robots. LIFEtool, with its extensive knowledge of online and offline speech recognition technologies, will support PROFACTOR in developing an interface to communicate human intentions with the robot. PROFACTOR will develop a “portable” activity detection system capable of detecting human actions using low-cost sensors. A feasibility study will also be conducted in the process to partially validate the applicability of such activity/gesture recognition system to other domains (health care). The advantage of such a module would be its applicability to different scenarios requiring the understanding of human intentions.
The strategy to achieve the goal that non-experts can easily teach robot systems is twofold. First, a ‘learning by interaction’ framework is developed in which the robot provides the user with a set of intelligent suggestions during the learning process. The robot uses its knowledge modeling and argumentation skills and takes into account the “current situation” (detected with the activity detection system) of the assembly environment to make these suggestions. A ‘learning by instruction’ framework is then developed that allows the use of ‘Natural Language’ as a communication mode between the user and the robot. Both frameworks are then combined into a bidirectional communication channel between the user and the robot in order to provide feedback or to re-learn (in whole or in part) the assembly process.
Project name:
BRIDGE – HUMAN ROBOT INTERACTION (TEACHBOTS)
Industrial Project
Duration:
04.2019 – 12.2020
Partners:
Profactor GmbH
LIFEtool GmbH
Keywords: Human Robot Collaboration; Programming by Interaction; Programming by Instruction; Artificial Intelligence
