Meta Platforms Technologies, LLC

Other

Meta Platforms, Inc.

John Jacob Blakeley

Jing Ma

Camila Cortes De Almeida E De Vincenzo

Jenna Velez

Cody Char

Annika Rodrigues

Gerrit Hendrik Hofmeester

Gagneet Singh Mac

Michael Luo

Pol Pla I Conesa

Ganesh Venkatesh

Michal Hlavac

Chengyuan Yan

Jenny Kam

Michael Ishigaki

Amy Lawson Bearman

Christopher E Balmes

Yiming Pu

Jossie E Tirado Arroyo

Alireza Dirafzoon

Matthew Dan Feiszli

Gabrielle Catherine Moskey

Jonathan Michael Proto

Paul Mealy

Kevin Harper

Babak Damavandi

Guangqiang Dong

Jiwen Ren

The present disclosure provides world-controlled augments and application-controlled augments. World-controlled augments can be controlled directly by a shell in the artificial reality environment. To allow even inexperienced users to develop world-controlled augments, a world-controlled builder system is provided. Application-controlled augments may be resource intensive (e.g., using eye-tracking, social-media tie-ins, etc.), may support complicated interactions among themselves, may require or have extensive use of inputs and permissioned resources, and are controlled by their hosting application. When a running application is halted, the application closes its application-controlled augments but can choose to have the XR system run a 'place-holder' world-controlled augment for as long as the application is not running. The place-holder world-controlled augment preserves the appearance of the application in the artificial reality environment but uses few system resources. Upon a user selecting a place-holder world-controlled augment, the XR system can run the associated application and close the place-holder world-controlled augment.

World-controlled and application-controlled augments in an artificial-reality environment

In one embodiment, a method includes rendering a first output image comprising one or more augmented-reality (AR) objects for displays of an AR rendering device of an AR system associated with a first user. The method further includes accessing sensor signals associated with the first user. The one or more sensor signals may be captured by sensors of the AR system. The method further includes detecting a change in a context of the first user with respect to a real-world environment based on the sensor signals. The method further includes rendering a second output image comprising the AR objects for the displays of the AR rendering device. One or more of the AR objects may be adapted based on the detected change in the context of the first user.

Dynamic content rendering based on context for AR and assistant systems

The present embodiments relate to display of glints associated with real-world objects in an environment displayed on an extra reality (XR) device. The glint can include a virtual object associated with a real-world object, such as an indication of a social interaction associated with a real-world object, a content item tagged to an object, etc. The system as described herein can present glints on a display of an XR device based on a distance between the XR device and a location associated with the glint. Responsive to selection of a glint in the environment, additional information can be presented relating to the glint or another action can be taken, such as to open an application. In some instances, a glint can include a series of search results relating to a corresponding real-world object to provide additional information relating to the real-world object.

Artificial reality environment with glints displayed by an extra reality device

Growing community of inventors

Seattle, WA, United States of America

John Jacob Blakeley