Facebook, Inc.

Meta Platforms Technologies, LLC

Meta Platforms, Inc.

Miguel Goncalves

Mykyta Lutsenko

Hermes Germi Pique Corchs

Mark I-Kai Wang

Marcin Kwiatkowski

Benjamin Blonder Leizman

Neil Anthony Clifford

Bret Hobbs

Lionel Laurent Reyero

Gabriel Barbosa Nunes

A virtual object system can coordinate interactions between multiple virtual objects in an artificial reality environment. Embodiments receive a first virtual object, the first virtual object including first properties, where the artificial reality environment is set in a real-world environment. Embodiments register the first properties of the first virtual object to receive notifications of events from the artificial reality environment. Embodiments receive one or more queries from a second virtual object and in response to the one or more queries, respond to the second virtual object with identified features of the real-world environment in which the artificial reality environment is set and identifications of one or more other virtual objects (e.g., the first virtual object). The second virtual object can use the identification of the first virtual object to register for events related to the first virtual object and/or communicate with the first virtual object.

Coordination of interactions of virtual objects

In one embodiment, the system may receive a serialized data stream generated by serializing data chunks including data from a video stream and contextual data streams associated with the video stream. The contextual data streams may include a first computed data stream and a sensor data stream. The system may extract the video data stream and one or more contextual data streams from the serialized data stream. The system may generate a second computed data stream based on the sensor data stream in the extracted contextual data streams. The system may compare the second computed data stream to the first computed data stream extracted from the serialized data stream to select a computed data stream based on one or more pre-determined criteria. The system may render an artificial reality effect for display with the extracted video data stream based at least in part on the selected computed data stream.

Data sterilization for post-capture editing of artificial reality effects

In one embodiment, the system captures a video data stream of a scene and contextual data streams associated with the video data stream. The contextual data streams comprise a sensor data stream or a computed data stream. The system renders an artificial reality effect based on the contextual data streams for display with the video data stream. The system generates a serialized data stream by serializing data chunks of the video data stream and the contextual data streams. The system stores the serialized data stream into a storage. The system extracts the video data stream and one or more of the contextual data streams from the serialized data stream by deserializing the data chunks in the serialized data stream. The system renders the same or another artificial reality effect for display with the extracted video data stream based on the extracted contextual data streams.

Growing community of inventors

Redwood City, CA, United States of America

Miguel Goncalves