Microsoft Technology Licensing, LLC

Benjamin James Andrews

Andrew Jackson Klein

Erik Alexander Hill

Techniques for intelligently repositioning a hologram for an object in a scene based on a past condition of the object and/or a planned future condition of the object are disclosed. A hologram is identified for an object in a scene. Identifying the hologram includes identifying a current location of the hologram within the scene. Time-based data associated with the object is accessed. The time-based data includes at least one of a past condition of the object or a planned future condition of the object. A new location for the hologram is selected within the scene. This selection is based on the time-based data. The hologram is then repositioned to the new location.

Smart placement of information based on dynamic environments

The disclosure herein describes enabling a user of a remote mixed reality (MR) device to observe an environment of a local MR device combined with 3D surface reconstruction (SR) mesh data and live video data. Optical data of a surface of an environment is obtained and a 3D surface reconstruction mesh of the surface is generated from the obtained optical data using photogrammetry. The generated 3D surface reconstruction mesh is provided for display by a remote device. A live video feed of a window region of the environment is obtained and the live video feed of the window region is provided for display on the generated 3D surface reconstruction mesh by the remote device. Further, a remote user is enabled to provide feedback to a user of the local MR device, including audio feedback such as speech and virtual artifacts that are displayed to the local user.

Growing community of inventors

Seattle, WA, United States of America

Benjamin James Andrews