Microsoft Technology Licensing, LLC

Andrew Jackson Klein

Darren Alexander Bennett

Jeremy Bruce Kersey

Ethan Harris Arnowitz

Charla Marie Pereira

Jonathon Burnham Cobb

Kyle Mouritsen

Enrico William Guld

Dean Alan Wadsworth

Helen Joan Hem Lam

Kin Hang Chu

David J W Seymour

Cory Ryan Bramall

Justin Thomas Savino

Stephen Michael Lucas

You-Da Yang

Julia Faye Taylor-Hell

Stuart John Mayhew

Kevin Thomas Mather

Robert István Butterworth

Victor Jia

Melissa Hellmund Vega

William Ben Hanke

Hendry Effendy

Cedric Lee

Cedric Caillaud

Darren Bennett

Kathleen Patricia Mulcahy

Erik Alexander Hill

Daniel Lee Osborn

Evan Lewis Jones

William Axel Olsen

Heather Joanne Alekson

Jason A Carter

Michael Edward Harnisch

Tsz Fung Wan

Sean Robert Puller

Benjamin James Andrews

Ryan Nadel

Struan Andrew Robertson

William Robert Schnurr

Mahesh Keshav Kamat

Maya Alethea Miller-Vedam

Kjartan Olafsson

Joel Jamon Rendon

Jason Drew Vantomme

Cydney Brooke Nielsen

Arni Mar Thrastarson

Alexandre Pierre Michel Godin

Zachary D Wiesnoski

Adam Roy Mitchell

Examples of augmented reality (AR) environment control advantageously employ multi-factor intention determination and include: performing a multi-factor intention determination for summoning a control object (e.g., a menu, a keyboard, or an input panel) using a set of indications in an AR environment, the set of indications comprising a plurality of indications (e.g., two or more of a palm-facing gesture, an eye gaze, a head gaze, and a finger position simultaneously); and based on at least the set of indications indicating a summoning request by a user, displaying the control object in a position proximate to the user in the AR environment (e.g., docked to a hand of the user). Some examples continue displaying the control object while at least one indication remains, and continue displaying the control object during a timer period if one of the indications is lost.

Multi-factor intention determination for augmented reality (AR) environment control

Techniques for intelligently repositioning a hologram for an object in a scene based on a past condition of the object and/or a planned future condition of the object are disclosed. A hologram is identified for an object in a scene. Identifying the hologram includes identifying a current location of the hologram within the scene. Time-based data associated with the object is accessed. The time-based data includes at least one of a past condition of the object or a planned future condition of the object. A new location for the hologram is selected within the scene. This selection is based on the time-based data. The hologram is then repositioned to the new location.

Smart placement of information based on dynamic environments

Various methods and systems are provided for authoring and presenting 3D presentations. Generally, an augmented or virtual reality device for each author, presenter and audience member includes 3D presentation software. During authoring mode, one or more authors can use 3D and/or 2D interfaces to generate a 3D presentation that choreographs behaviors of 3D assets into scenes and beats. During presentation mode, the 3D presentation is loaded in each user device, and 3D images of the 3D assets and corresponding asset behaviors are rendered among the user devices in a coordinated manner. As such, one or more presenters can navigate the scenes and beats of the 3D presentation to deliver the 3D presentation to one or more audience members wearing augmented reality headsets.

Authoring and presenting 3D presentations in augmented reality

Systems and methods for attaching a virtual input device to a virtual object in a mixed reality (MR) environment are provided. The system includes a memory, a processor communicatively coupled to the memory, and a display device. The display device is configured to display a MR environment provided by at least one application implemented by the processor. The mixed reality environment includes a virtual object corresponding to an application, and a virtual input device. The at least one application docks the virtual input device to the virtual object with an offset relative to the virtual object.

Intelligent keyboard attachment for mixed reality input

The disclosed technology is generally directed to mixed-reality devices. In one example of the technology, a first mixed-reality guide is provided mixed-reality devices, enabling the mixed-reality devices to operate the first mixed-reality guide while providing a mixed-reality view, such that: while the first mixed-reality guide is navigated to a step of the set of steps of the first mixed-reality guide, the mixed-reality view includes a hologram at a real-world location in the real-world environment at which work associated with the step is to be performed. From each mixed-reality device, mixed-reality data is received based on use of at least the first mixed-reality guide on the mixed-reality device. The mixed-reality data includes spatial telemetry data collected for at least one step of the first mixed-reality guide. A presentation that is based on the mixed-reality data is provided. The first mixed-reality guide is enabled to be altered based on the mixed-reality data.

Mixed-reality guide data collection and presentation

The disclosed technology is generally directed to mixed reality devices. In one example of the technology, a mixed-reality view is caused to be provided to an operator. The mixed-reality view includes both a real-world environment of the operator and holographic aspects. While the operator is navigated to a step of the task, the mixed-reality view is caused to include a step card, such that the step card includes at least one instruction associated with the step. The operator is enabled to adjust a state associated with the step card. While the state associated with the step card is a first state: a gaze determination associated with a gaze of the operator is made; and responsive to a positive gaze determination, the step card is caused to move to a location that is associated with a real-world location of the gaze of the operator.

Ergonomic mixed reality information delivery system for dynamic workflows

The disclosed technology is generally directed to mixed reality, augmented reality, and/or virtual reality devices. In one example of the technology, a first hologram is caused to be displayed to an operator with a first gaze selection area that is associated with a first selectable option. A gaze location that is associated with a gaze of the operator is evaluated. Responsive to the gaze location coinciding with the first gaze selection area of the first hologram, a first gaze dwell timer is begun. A total duration of the first gaze dwell timer is adjusted based on the gaze location being in a specific portion of the first gaze selection area. Responsive to the gaze dwell timer finishing, the first selectable option is caused to be selected.

Mixed reality device gaze invocations

A system may include a memory device to store instructions and data, and at least one processing device to execute the instructions stored in the memory device to: receive a background image and a digital object to be composited onto the background image in a mixed reality view, generate a 2D bounding region for the digital object, select a version of the background image at a pre-defined resolution, overlay the 2D bounding region on the selected version of the background image and obtain a set of samples of the colors of pixels of the selected version along a perimeter of the 2D bounding region, and determine a value for one or more digital lighting sources to illuminate the digital object in the mixed reality view, based, at least in part, on the set of samples.

Real-time compositing in mixed reality

The disclosed technology is generally directed to mixed reality devices. In one example of the technology, a mixed-reality view is caused to be provided to an operator, wherein the mixed-reality view includes both a real-world environment of the operator and holographic aspects. The operator is enabled to navigate among a plurality of steps of a task, such that for at least one step of the plurality of steps of the task, while the operator is navigated to the step of the task: the mixed-reality view is caused to include at least one instruction associated with the step. The mixed-reality view is caused to include a hologram at a real-world location in the real-world environment at which work associated with the step is to be performed. The mixed-reality view is caused to continually include a visual tether from the instruction to the real-world location.

Ergonomic mixed reality step-by-step instructions tethered to 3D holograms in real-world locations

Various methods and systems, for implementing three-dimensional resource integration, are provided. 3D resource integration includes integration of 3D resources into different types of functionality, such as, operating system, file explorer, application and augmented reality functionality. In operation, an indication to perform an operation with a 3D object is received. One or more 3D resource controls, associated with the operation, are accessed. The 3D resource control is a defined set of instructions on how to integrate 3D resources with 3D objects for generating 3D-based graphical interfaces associated with application features and operating system features. An input based on one or more control elements of the one or more 3D resource controls is received. The input includes the one or more control elements that operate to generate a 3D-based graphical interface for the operation. Based on receiving the input, the operation is executed with the 3D object and the 3D-based graphical interface.

Three-dimensional resource integration system

Growing community of inventors

Vancouver, Canada

Andrew Jackson Klein