System and method for generating asynchronous augmented reality instructions

Abstract

A method of operating an augmented reality (AR) system includes capturing images of a first real-world workspace using a camera of a first head mounted AR device of the AR system being worn by a first user, processing the images using a first processor of the AR system to identify physical objects in the first real-world workspace and detect 3D positions of the identified physical objects in a 3D space corresponding to the first real-world workspace, rendering virtual objects representing the identified physical objects on the display of the first head mounted AR device at the respective 3D positions for the identified physical objects, manipulating a first one of the virtual objects using at least one hand-held controller of the AR system in a manner that mimics a performance of a first procedural task using the physical object associated with the first one of the virtual objects, recording the manipulation of the first one of the virtual objects that mimics the performance of the first procedural task as first augmented reality content, and storing the first augmented reality content in a memory of the AR system.