Meta Platforms Technologies, LLC

Jonathan Lim

Willy Huang

Yuanshuo Lu

Szeyin Lee

Kyle Sejin Yoon

Alex Garcia Goncalves

Andrew Morrison

Methods and systems for coordinating operation of a head-wearable device and an electronic device to assist a user in interacting with the electronic device are disclosed. A method includes, while a user interface is displayed on a display of an electronic device associated with a user, receiving sensor data from one or more sensors of the electronic device or from a head-wearable device worn by the user that is in communication with the electronic device. The method includes determining, based at least in part on the sensor data from the one or more sensors, whether an augmented-display criterion is satisfied for the electronic device, and, in accordance with a determination that the augmented-display criterion is satisfied, causing presentation, via a display of the head-wearable device, of an augmented representation of the user interface.

Systems and methods for coordinating operation of a head-wearable device and an electronic device to assist a user in interacting with the electronic device

An augmented reality (AR) effect system can improve application of AR effects by sharing resources between AR effects. The AR effect system can employ manifests for AR effects that define which resources are required to render each AR effect. The AR effect system can organize rendering operations used by selected AR effects into a pipeline and can use the manifests of the AR effects to determine when each resource will be needed. Based on this pipeline, the AR effect system can create a cache order defining a resource schedule which specifies, when a resource is freed, conditions for whether to save the resource to a local cache or unload the resource. As rendering of the video with the AR effects progresses, the resource schedule can control whether resources not currently being used to render an AR effect should be unloaded or cached for fast access for future render operations.

Sharing of resources for generating augmented reality effects

Growing community of inventors

Oakland, CA, United States of America

Jonathan Lim