Microsoft Technology Licensing, LLC

Meta Platforms Technologies, LLC

Jenny Kam

Julia Schwarz

Nicholas Ferianc Kamuda

Mathew Julian Lamb

Sophie Stellmach

Sheng Kai Tang

Adam Edwin Behringer

Joshua Kyle Neff

Kenneth Mitchell Jakubzak

Amy Mun Hong

Michael Harley Notter

Steven T Kaneko

Chaitanya Dev Sareen

Alice Jane Bernheim Brush

Pol Pla I Conesa

Aleksandar Uzelac

Sergio Paolantonio

Michal Hlavac

Vishwac Sena Kannan

Daniel J Hwang

Alton Kwok

Brian Kramp

Yaser Khan

Dennis Mooney, Ii

John Jacob Blakeley

Michael Ishigaki

Dong Back Kim

Jossie E Tirado Arroyo

Alon Farchy

Jonathan Eric Foster

Kevin Harper

James Leslie Humphrey, Iii

Jonathan Michael Proto

Paul Mealy

James Leslie Iii Humphrey

Dennis James Ii Mooney

The present disclosure provides world-controlled augments and application-controlled augments. World-controlled augments can be controlled directly by a shell in the artificial reality environment. To allow even inexperienced users to develop world-controlled augments, a world-controlled builder system is provided. Application-controlled augments may be resource intensive (e.g., using eye-tracking, social-media tie-ins, etc.), may support complicated interactions among themselves, may require or have extensive use of inputs and permissioned resources, and are controlled by their hosting application. When a running application is halted, the application closes its application-controlled augments but can choose to have the XR system run a 'place-holder' world-controlled augment for as long as the application is not running. The place-holder world-controlled augment preserves the appearance of the application in the artificial reality environment but uses few system resources. Upon a user selecting a place-holder world-controlled augment, the XR system can run the associated application and close the place-holder world-controlled augment.

World-controlled and application-controlled augments in an artificial-reality environment

Examples are disclosed that relate to hand gesture-based emojis. One example provides, on a display device, a method comprising receiving hand tracking data representing a pose of a hand in a coordinate system, based on the hand tracking data, recognizing a hand gesture, and identifying an emoji corresponding to the hand gesture. The method further comprises presenting the emoji on the display device, and sending an instruction to one or more other display devices to present the emoji.

Hand gesture-based emojis

Systems and methods are provided for selectively controlling a carry mode for holograms presented in mixed-reality environments and for providing leashing buffers for the holograms. The carry mode enables holograms to be functionally moved within a single mixed-reality environment, and out into one or more different mixed-reality environments. The carry mode can be automatically applied to holograms created within the mixed-reality environment. The carry mode can also be applied responsive to user input applied to world-locked holograms, which triggers a switch from the world-locked mode to the carry mode from. Holograms can also be leashed for persistently displaying holograms associated with or linked to a user in the mixed-reality environment to provide the user increased accessibility to the hologram while navigating within and without a particular mixed-reality environment. Selectable options are presented with a hologram in carry mode for switching from the carry mode to the world-locked mode.

Interactive carry

Optimizations are provided for facilitating optimal viewing positions for viewing virtual objects in VR environments. Initially, user selection of a virtual object being rendered in a VR display is detected. Subsequently, an optimal viewing position is dynamically calculated based on one or more characteristic of the virtual object to be viewed. A predetermined triggering event is also detected, and in response to the predetermined triggering event, a scene which is arranged to display the selected virtual object from the optimal viewing position is rendered in the VR display.

Repositioning user perspectives in virtual reality environments

An electronic device in a topology of interconnected electronic devices can listen for a wake phrase and voice commands. The device can control when and how it responds so that a single device responds to voice commands. Per-task device preferences can be stored for a user. If a preferred device is not available, the task can still be performed on a device that has appropriate capabilities. Machine learning can determine a user's preferences. Power conservation and effective user interaction can result.

Device arbitration for listening devices

Growing community of inventors

Seattle, WA, United States of America

Jenny Kam