Augmented reality system and method for conveying to a human operator information associated with human-imperceptible indicia within an operating environment of a robot

Abstract

A robotic system comprising a robot, and human-imperceptible indicia associated with an object within an environment, the human-imperceptible indicia comprising or linking to interaction information pertaining to a predetermined intended interaction of the robot with the object, the interaction information facilitating interaction with the object by the robot in accordance with the predetermined intended interaction. The system can comprise a sensor that senses the human-imperceptible indicia and the interaction information, and an augmented reality system for conveying human-understandable information to a human operator, which is associated with the interaction or linking information. The machine readable indicia can comprise symbols that can be sensed and interpreted by the robot or the augmented reality system. The robot can utilize a camera to transmit a real-world view of the operating environment to the augmented reality system that can be combined with the human-understandable information to provide augmented reality operation of the robot.