Tracking location and resolving drift in augmented reality head mounted displays with downward projection

Abstract

Embodiments provide for tracking location and resolving drift in Augmented Reality (AR) devices. The AR devices includes computing devices having screens on a first face and cameras on a second, opposite face to project an image onto optical arrangements for viewing by wearers of the AR devices. The AR devices map locations for real objects in the environment to a virtual environment; anchor virtual objects at anchor locations within the virtual environment; capture station keeping images of the environment from a first Field of View via the camera; determine a second, different Field of View in the environment for the wearer of the AR device based on the relative locations of real objects present in the station keeping images; and output images depicting the virtual objects at positions on the screen to depict the virtual objects in the physical environment at the anchor locations.