Microsoft Technology Licensing, LLC

Rec Room Inc.

Dan B Kroymann

Cameron Graeme Brown

Nicholas Fajt

Joshua Wehrly

Omer Bilal Orhan

Arthur Charles Tomlin

Johnathan Bevis

Brian James Mount

Adam G Poulos

Gregory Alt

Evan Michael Keibler

Daniel Joseph McCulloch

Anthony James Ambrus

Roger Sebastian-Kevin Sylvan

Li Erran Li

Rebecca Claire Weiss

Wenbo Zhang

Brendan Reville

Cameron Quinn Egbert

Mathew Julian Lamb

Jeffrey David Henshaw

Thomas A Langan

Stacey Law

Derek H Smith

Lewey Geselowitz

Jonathan Lyons

Erik Andrew Saltwell

Jeffrey L Allen

Will Guyman

Jeffrey Wallace McGlynn

Bjorn Toft Madsen

Jonathan Bevis

Rodney Alan Boyd

Fabrice Odero

Robert El-Soudani

Matthew Johnson

Jorge Tosar

Jeff W McGlynn

Jeremy Hance

Michael Ey

Alexander Georg Pfaffe

Chris Word

Jeffrey Wallace Mcglynn

Gregory Lowell Alt

Daniel Mcculloch

In some embodiments, a computer-implemented method of managing editing of virtual environment objects is provided. A computing system receives a first studio-version object created in a creation studio application executed by a designer computing device. The creation studio application is associated with a game engine. The computing system transmits a first binary object based on the first studio-version object to a virtual environment client computing device. The computing system receives a first VE editor object created in a virtual environment editor executed by the virtual environment client computing device. The first VE editor object includes at least a reference to the first binary object. The computing system creates a first studio-version VE editor object that includes at least a reference to the first studio-version object and the first VE editor object; and transmits the first studio-version VE editor object to the designer computing device.

Bi-directional exchange of edited virtual objects between a design environment and a virtual environment

In some embodiments, techniques for managing interaction permissions for an object in a shared virtual environment are provided. The techniques may determine whether to present an object in a limited-interaction mode or in an interactive mode based on a permission condition. The permission condition may include a proximity condition that specifies a proximity threshold between two objects within the shared virtual environment that should be met in order to provide the object in the interactive mode. The proximity threshold may specify a distance between an avatar of an owning user of the object and the object; a distance between an avatar of an owning user of the object and an avatar of a user being presented the object, or other distances.

Systems and method for managing permission for interacting with virtual objects based on virtual proximity

An endpoint system including one or more computing devices presents an object in a virtual environment (e.g., a shared virtual environment); receives gaze input corresponding to a gaze of a user of the endpoint system; calculates a gaze vector based on the gaze input; receives motion input corresponding to an action of the user; determines a path adjustment (e.g., by changing motion parameters such as trajectory and velocity) for the object based at least in part on the gaze vector and the motion input; and simulates motion of the object within the virtual environment based at least in part on the path adjustment. The object may be presented as being thrown by an avatar, with a flight path based on the path adjustment. The gaze vector may be based on head orientation information, eye tracking information, or some combination of these or other gaze information.

Systems and methods for assisting virtual gestures based on viewing frustum

An endpoint system including one or more computing devices receives user input associated with an avatar in a shared virtual environment; calculates, based on the user input, motion for a portion of the first avatar, such as a hand; determines, based on the user input, a first gesture state for first avatar; transmits first location change notifications and a representation of the first gesture state for the first avatar; receives second location change notifications and a representation of a second gesture state for a second avatar; detects a collision between the first avatar and the second avatar based on the first location change notifications and the second location change notifications; and identifies a collaborative gesture based on the detected collision, the first gesture state, and the second gesture state.

Systems and methods for detecting collaborative virtual gestures

One or more sensors of a virtual reality device track a pose of the virtual reality device. The virtual reality device requests a virtual image having a perspective corresponding to a future pose from a remote computer. After receiving the requested virtual image, the virtual reality device adjusts the virtual image to an adjusted virtual image having an updated perspective corresponding to an updated tracked pose of the virtual reality device. Then, a virtual reality display displays the adjusted virtual image.

Remote rendering for virtual images

In some embodiments, a detecting endpoint system accessing a shared virtual environment detects a collision between a target avatar and an object within the shared virtual environment. The detecting endpoint system transmits a location change notification for a head of the target avatar. An observer endpoint system moves the head of the target avatar based on the location change notification. A target endpoint system associated with the target avatar does not move its viewpoint based on the location change notification. In some embodiments, this decoupling of viewpoint from the avatar allows for a more immersive experience for all users.

Systems and methods providing temporary decoupling of user avatar synchronicity for presence enhancing experiences

In some embodiments of the present disclosure, endpoint systems participating in a shared virtual environment simulate objects locally that a user of the endpoint system is likely to interact with. In some embodiments, object authority is thus managed by the endpoint systems, and is not managed by a central server. In some embodiments, a subsequent endpoint system likely to interact with an object may be predicted, and object authority may be transferred to the subsequent endpoint system before the interaction in order to provide an immersive experience for a user of the subsequent endpoint system. In some embodiments, efficient techniques for transmitting notifications between endpoint systems are provided.

Systems and methods for transferring object authority in a shared virtual environment

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a display system. For example, one disclosed embodiment includes displaying a virtual object via the display system as free-floating, detecting a trigger to display the object as attached to a surface, and, in response to the trigger, displaying the virtual object as attached to the surface via the display system. The method may further include detecting a trigger to detach the virtual object from the surface and, in response to the trigger to detach the virtual object from the surface, detaching the virtual object from the surface and displaying the virtual object as free-floating.

Interactions of virtual objects with surfaces

A system and method are disclosed for capturing views of a mixed reality environment from various perspectives which can be displayed on a monitor. The system includes one or more physical cameras at user-defined positions within the mixed reality environment. The system renders virtual objects in the mixed reality environment from the perspective of the one or more cameras. Real and virtual objects from the mixed reality environment may then be displayed from the perspective of the one or more cameras on one or more external, 2D monitor for viewing by others.

Holographic bird's eye view camera

Methods for automatically generating a texture exemplar that may be used for rendering virtual objects that appear to be made from the texture exemplar are described. In some embodiments, a head-mounted display device (HMD) may identify a real-world object within an environment, acquire a three-dimensional model of the real-world object, determine a portion of the real-world object from which a texture exemplar is to be generated, capture one or more images of the portion of the real-world object, determine an orientation of the real-world object, and generate the texture exemplar using the one or more images, the three-dimensional model, and the orientation of the real-world object. The HMD may then render and display images of a virtual object such that the virtual object appears to be made from a virtual material associated with the texture exemplar.

Automatic generation of virtual materials from real-world materials

Methods for enabling hands-free selection of objects within an augmented reality environment are described. In some embodiments, an object may be selected by an end user of a head-mounted display device (HMD) based on detecting a vestibulo-ocular reflex (VOR) with the end user's eyes while the end user is gazing at the object and performing a particular head movement for selecting the object. The object selected may comprise a real object or a virtual object. The end user may select the object by gazing at the object for a first time period and then performing a particular head movement in which the VOR is detected for one or both of the end user's eyes. In one embodiment, the particular head movement may involve the end user moving their head away from a direction of the object at a particular head speed while gazing at the object.

Radial selection by vestibulo-ocular reflex fixation

Growing community of inventors

Bothell, WA, United States of America

Dan B Kroymann