Facebook, Inc.

Meta Platforms, Inc.

Facebook Technologies, LLC

Michael Slater

Stef Marc Smet

Leo Litterello Mancini

Joshua Alexander Miller

Dolapo Omobola Falola

Siarhei Hanchar

Sergei Viktorovich Anpilov

Danil Gontovnik

Yu Hang Ng

Benjamin Patrick Blackburne

Hannes Luc Herman Verlinde

Samantha P Krug

Sharon Zeng

Milen Georgiev Dzhumerov

Prakarn Nisarat

Chunjie Jia

Ram Kumar Hariharan

Michael Philip Arcuri

Volodymyr Giginiak

Joshua Ryan Williams

Guilherme Schneider

Lars Anders Bond

Christopher John Ocampo

Bo Yin

Alexander Nicholas Rozanski

Karthik Subramanyam

Volodymyr Gigniak

Francesco Georg

Thomas Paul Mann

Hannes Verlinde

Andrew James Senior

In one embodiment, a computer-implemented method includes receiving, through a user interface (UI) of an artificial-reality (AR) design tool, a selection of a configurable interface element to place the AR design tool and the UI into a configure phase to configure an AR effect. The computer-implemented method further includes receiving, through the UI of the AR design tool after the AR design tool and the UI are placed into the configure phase in response to selecting the configurable interface element, instructions to add a voice-command module to the AR effect. The computer-implemented method further includes configuring, while the AR design tool and the UI are placed into the configure phase, one or more parameters of the voice-command module. The computer-implemented method further includes generating the AR effect utilizing a particular voice command at runtime based on configured one or more parameters of the voice-command module.

Visual editor for designing augmented-reality effects that utilize voice recognition

Systems, methods, client devices, and non-transitory computer-readable media are disclosed for utilizing video data and video processing data to enable shared augmented reality scenes having video textures depicting participants of video calls as augmented reality (AR) effects during the video calls. For instance, the disclosed systems can establish a video call between client devices that include streaming channels (e.g., a video and audio data channel). In one or more implementations, the disclosed systems enable the client devices to transmit video processing data and video data of a participant through the streaming channel during a video call. Indeed, in one or more embodiments, the disclosed systems cause the client devices to utilize video data streams and video processing data to render videos as video textures within AR effects in a shared AR scene (or AR space) of the video call (e.g., to depict participants within the AR scene).

Generating shared augmented reality scenes utilizing video textures from video streams of video call participants

A computer-implemented method, comprising, by an artificial-reality (AR) design tool: receiving, through a user interface (UI) of the AR design tool, instructions to add a voice-command module to an AR effect, the voice-command module having an intent type and at least one slot, the slot associated with one or more entities; establishing, according to instructions received through the UI, a logical connection between the slot and a logic module configured to generate the AR effect depending on a runtime value associated with the slot; and generate, for the AR effect, an executable program configured to: determine that a detected utterance corresponds to the intent type and includes one or more words associated with the slot; select, based on the one or more words, one of the one or more entities as the runtime value for the slot; send the runtime value to the logic module according to the logical connection.

A virtual reality (VR) system is described that enables users to create, model, and visualize augmented reality experiences at physical, real-world locations, without needing to physically be at the location for which the augmented experience is being modeled. In one example, the VR system includes a head-mounted device (HMD), an augmented reality content development system, and a rendering engine. The HMD is configured to output VR content representing a physical environment for an augmented reality experience. The augmented reality content development system is configured to identify, based on an input, augmented reality content with which to augment the physical environment for the augmented reality experience. The rendering engine is configured to render, via the HMD, the VR content representing the physical environment, augmented with the augmented reality content.

Virtual reality-based augmented reality development system

One or more embodiments of the disclosure provide systems and methods for providing media presentations to users of a media presentation system. A media presentation generally includes a plurality of media segments provided by multiple users of the media presentation system. In one or more embodiments, a user of the media presentation system may share a media presentation with a co-user. The media presentation system can enable the co-user, if authorized by the user, to contribute (e.g., add a media segment) to a media presentation shared with the co-user.

Multi-user media presentation system

In one embodiment, a method includes a computer machine reviewing a picture image and an associated video with the associated video including several video frames. The computer machine then statistically analyzes the corresponding areas for each video frame. The computer machine then compares an area in the picture image with an associated area in a video frame image, wherein the video frame image is based in part on the statistical analysis of the corresponding area for each video frame. Next, the computer machine creates an area for a composite image based in part on the comparison of the area in the picture image with the associated area in the video frame image.

Long exposure filter

In one embodiment, a method for designing an augmented-reality effect may include displaying a virtual object in a 3D space of a user interface comprising a first and second display areas, wherein the virtual object is displayed from a first perspective in the first display area and displayed from a second perspective in the second display area, the second perspective being different from the first perspective, receiving, via the user interface, instructions to adjust the virtual object, adjusting the virtual object according to the instructions, and displaying the adjusted virtual object in the 3D space of the user interface, wherein the adjusted virtual object is displayed from the first perspective in the first display area and displayed from the second perspective in the second display area.

Visual editor for designing augmented-reality effects

In one embodiment, a method includes by a computing device, displaying a user interface for designing augmented-reality effects. The method includes receiving user input through the user interface. The method includes displaying a graph generated based on the user input. The graph may include multiple nodes and one or more edges. The nodes may include a detector node and a filter node connected by one or more edges. The method includes detecting, in accordance with an object type specified by the detector node, one or more object instances of the object type appearing in a scene. The method includes selecting, in accordance with at least one criterion specified by the filter node, at least one of the one or more detected object instances that satisfies the criterion. The method includes rendering an augmented-reality effect based on at least the selected object instance.

Systems and methods for graph-based design of augmented-reality effects

A social networking system provides a user with a newsfeed that includes content selected by the social networking system for presentation to the user and allows the user to request a user-specific profile feed associated with an additional user connected to the user on the social networking system. The user-specific profile feed includes content received from the additional user and designated by the additional user as eligible for presentation in a user-specific profile feed associated with the additional user. If the user requests to view the user-specific profile feed, the social networking system generates and presents the user with the user-specific profile feed including the designated content and information identifying the additional user from whom the content was received. The social networking system stores a visitation state identifying the user presented with the user-specific profile feed and provides information describing the visitation state to the additional user.

Generating a user-specific profile feed associated with a visitation state for presentation to a user of a social networking system

Techniques that enable a third party to author and add functionality to a target application. A third party may create or author a script that encodes the functionality to be added to the target application. The script may then be provided to and executed by the target application, where execution of the script causes the functionality to be added to the target application. In certain embodiments, the added functionality may be in the form of effects that are output via the target application when the script is executed by the target application. The effects may include audio-visual effects that are displayed or output by the target application and may also include displaying data provided by a third party.

Enabling third parties to add effects to an application

In one embodiment, a method includes displaying, on a client system, a visual scene with one or more first objects and one or more second objects. The one or more second objects are associated with an augmented reality context. A first touch event handler, associated with an operating system running on the client system, may receive a set of touch events and send the set of touch events to a second touch event handler running on the client system. The second touch event handler may detect a first subset of touch events relating to the one or more second objects. The second touch event handler may process the first subset of touch events and send a second subset of touch events relating to the one or more first objects to the first touch event handler. The first touch event handler may process the second subset of touch events.

Systems and methods for gesture handling in a three-dimensional visual scene

In one embodiment, a method for designing an augmented-reality effect may include receiving a model definition of a virtual object. The virtual object may be rendered in a 3D space based on the model definition. The system may display the virtual object in the 3D space from a first perspective in a first display area of a user interface. The system may display the virtual object in the 3D space from a second perspective, different from the first, in a second display area of the user interface. The system may receive a user command input by a user through the first display area for adjusting the virtual object. The virtual object may be adjusted according to the user command. The system may display the adjusted virtual object in the 3D space from the first perspective in the first display area and from the second perspective in the second display area.

Growing community of inventors

Nottingham, United Kingdom

Michael Slater