Microsoft Technology Licensing, LLC

Meta Platforms Technologies, LLC

Other

Facebook Technologies, LLC

James Tichenor

Hayden Schoen

Barrett Fox

Michal Hlavac

Arthur Zwiegincew

Gregory Alt

Todd K Harris

Merlyn Deng

Alex Marcolina

Bharat Ahluwalia

Julia Schwarz

Andrew Clark Goris

Scott Fullam

Lev Cherkashin

David Rohn

Steven James Velat

Yeliz Karadayi

Travis Scott Legg

David J Calabrese

Yasaman Sheri

Lori Ann Potts

Craig Haskins

Aaron Burns

Robert C J Pengelly

Robert Pengelly

Bede Jordan

Jamie Marconi

Scott Francis Fullam

Robert Cj Pengelly

Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An 'augment' is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.

Artificial reality augments and surfaces

Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An 'augment' is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a 'surface' that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.

Artificial realty augments and surfaces

Aspects of the present disclosure are directed to setting a display mode for a virtual object based on a display mode timer that is controlled by context factors. An artificial reality system can associate one or more virtual objects with a corresponding display mode timer. Various ranges on the display mode timer can be mapped to different display modes that the virtual object can assume. The display mode timer can be adjusted to add time based on a determination of a user focusing on the virtual object or other context factors. Display mode timers can also have rules for setting other display mode timer properties, such as how quickly the display mode timer runs down, that are evaluated based on context factors.

Metering for display modes in artificial reality

Examples of mixed reality computing devices that utilize remote sensors and local sensors as input devices are disclosed. In one example, a mixed reality computing device comprises an image sensor, a remote input device, a processor, and storage comprising stored instructions. The stored instructions are executable by the processor to perform object motion tracking and environmental tracking based on output from the image sensor, and in response to detecting that the remote input device is in use, adjust a parameter of the motion tracking while maintaining the environmental tracking.

Object motion tracking with remote device

In various embodiments, computerized methods and systems for mediating interaction methodologies with virtual objects rendered in an immersive environment are provided. An intended target is identified from one or more virtual objects rendered in an at least partially-virtual environment. A relative proximity of the intended target to the user, or an extension of the user, is determined. An interaction methodology is selected for interaction with the intended target based on the determined relative proximity to the intended target, among other things. An indication of the selected interaction methodology is then provided to the user.

Mediation of interaction methodologies in immersive environments

Altering properties of rendered objects and/or mixed reality environments utilizing control points associated with the rendered objects and/or mixed reality environments is described. Techniques described can include detecting a gesture performed by or in association with a control object. Based at least in part on detecting the gesture, techniques described can identify a target control point that is associated with a rendered object and/or a mixed reality environment. As the control object moves within the mixed reality environment, the target control point can track the movement of the control object. Based at least in part on the movement of the control object, a property of the rendered object and/or the mixed reality environment can be altered. A rendering of the rendered object and/or the mixed reality environment can be modified to reflect any alterations to the property.

Altering properties of rendered objects via control points

A gaze vector of a human subject is translated to a targeting vector that defines focus within a graphical user interface. Sensor data is received from a sensor system indicating pitch angle of a head of the human subject defining the gaze vector. The pitch angle is translated to a scaled pitch angle according to a pitch scaling function that increases amplification of the pitch angle in one or more directions as the pitch angle exceeds a start angle threshold in each of the one or more directions. The scaled pitch angle is output as a component of the targeting vector.

Head-based targeting with pitch amplification

Growing community of inventors

Seattle, WA, United States of America

James Tichenor