Facebook, Inc.

Meta Platforms, Inc.

Facebook Technologies, LLC

Stef Marc Smet

Michael Slater

Guilherme Schneider

Siarhei Hanchar

Hannes Luc Herman Verlinde

Samantha P Krug

Dolapo Omobola Falola

Danil Gontovnik

Benjamin Patrick Blackburne

Sergei Viktorovich Anpilov

Yu Hang Ng

Ram Kumar Hariharan

Chunjie Jia

Milen Georgiev Dzhumerov

Prakarn Nisarat

Vincent Charles Cheung

Michael Philip Arcuri

Volodymyr Giginiak

Joshua Ryan Williams

Lars Anders Bond

Christopher John Ocampo

Bo Yin

Alexander Nicholas Rozanski

Karthik Subramanyam

Hermes Germi Pique Corchs

Maria Chiara Cacciani

Andrew James Thomas Buckley

Milen Georgiev Ozhumerov

Thomas Paul Mann

Mircea-Gabriel Suciu

Muhammed Elsayed Muhammed Elsayed Ibrahim

Cunpu Bo

Volodymyr Gigniak

Francesco Georg

Hannes Verlinde

In one embodiment, a computer-implemented method includes receiving, through a user interface (UI) of an artificial-reality (AR) design tool, a selection of a configurable interface element to place the AR design tool and the UI into a configure phase to configure an AR effect. The computer-implemented method further includes receiving, through the UI of the AR design tool after the AR design tool and the UI are placed into the configure phase in response to selecting the configurable interface element, instructions to add a voice-command module to the AR effect. The computer-implemented method further includes configuring, while the AR design tool and the UI are placed into the configure phase, one or more parameters of the voice-command module. The computer-implemented method further includes generating the AR effect utilizing a particular voice command at runtime based on configured one or more parameters of the voice-command module.

Visual editor for designing augmented-reality effects that utilize voice recognition

A computer-implemented method, comprising, by an artificial-reality (AR) design tool: receiving, through a user interface (UI) of the AR design tool, instructions to add a voice-command module to an AR effect, the voice-command module having an intent type and at least one slot, the slot associated with one or more entities; establishing, according to instructions received through the UI, a logical connection between the slot and a logic module configured to generate the AR effect depending on a runtime value associated with the slot; and generate, for the AR effect, an executable program configured to: determine that a detected utterance corresponds to the intent type and includes one or more words associated with the slot; select, based on the one or more words, one of the one or more entities as the runtime value for the slot; send the runtime value to the logic module according to the logical connection.

A virtual reality (VR) system is described that enables users to create, model, and visualize augmented reality experiences at physical, real-world locations, without needing to physically be at the location for which the augmented experience is being modeled. In one example, the VR system includes a head-mounted device (HMD), an augmented reality content development system, and a rendering engine. The HMD is configured to output VR content representing a physical environment for an augmented reality experience. The augmented reality content development system is configured to identify, based on an input, augmented reality content with which to augment the physical environment for the augmented reality experience. The rendering engine is configured to render, via the HMD, the VR content representing the physical environment, augmented with the augmented reality content.

Virtual reality-based augmented reality development system

In one embodiment, a method includes a computer machine reviewing a picture image and an associated video with the associated video including several video frames. The computer machine then statistically analyzes the corresponding areas for each video frame. The computer machine then compares an area in the picture image with an associated area in a video frame image, wherein the video frame image is based in part on the statistical analysis of the corresponding area for each video frame. Next, the computer machine creates an area for a composite image based in part on the comparison of the area in the picture image with the associated area in the video frame image.

Long exposure filter

In one embodiment, a method may include running, by a computing device, an augmented-reality design editor for designing augmented-reality effects. A video with a first visual object may be displayed within a graphical user interface of the augmented-reality design editor. One or more trackers may be associated with the first visual object in response to a first input from a user. An augmented-reality object may be added in real-time into the graphical user interface of the augmented-reality design editor in response to a second input and may be associated with the one or more trackers in response to a third input. The first visual object and the augmented-reality object may move according to movements of the one or more tracker. Information defining relationships between the first visual object, the augmented-reality object, and the one or more trackers may be stored in one or more files.

Visual editor for designing augmented-reality effects and configuring rendering parameters

In one embodiment, a method for designing an augmented-reality effect may include displaying a virtual object in a 3D space of a user interface comprising a first and second display areas, wherein the virtual object is displayed from a first perspective in the first display area and displayed from a second perspective in the second display area, the second perspective being different from the first perspective, receiving, via the user interface, instructions to adjust the virtual object, adjusting the virtual object according to the instructions, and displaying the adjusted virtual object in the 3D space of the user interface, wherein the adjusted virtual object is displayed from the first perspective in the first display area and displayed from the second perspective in the second display area.

Visual editor for designing augmented-reality effects

In one embodiment, a method includes by a computing device, displaying a user interface for designing augmented-reality effects. The method includes receiving user input through the user interface. The method includes displaying a graph generated based on the user input. The graph may include multiple nodes and one or more edges. The nodes may include a detector node and a filter node connected by one or more edges. The method includes detecting, in accordance with an object type specified by the detector node, one or more object instances of the object type appearing in a scene. The method includes selecting, in accordance with at least one criterion specified by the filter node, at least one of the one or more detected object instances that satisfies the criterion. The method includes rendering an augmented-reality effect based on at least the selected object instance.

Systems and methods for graph-based design of augmented-reality effects

Techniques that enable a third party to author and add functionality to a target application. A third party may create or author a script that encodes the functionality to be added to the target application. The script may then be provided to and executed by the target application, where execution of the script causes the functionality to be added to the target application. In certain embodiments, the added functionality may be in the form of effects that are output via the target application when the script is executed by the target application. The effects may include audio-visual effects that are displayed or output by the target application and may also include displaying data provided by a third party.

Enabling third parties to add effects to an application

In one embodiment, a method for designing an augmented-reality effect may include associating, by a computing device, a first visual object with a first rendering order specified by a user. A second visual object may be associated with a second rendering order specified by the user. The first and second visual objects may be defined in a three-dimensional space. Information associated with the first visual object, the first rendering order, the second visual object, and the second rendering order may be stored in one or more files. The one or more files may be configured to cause the first visual object and the second visual object to be rendered sequentially in an order determined based on the first rendering order and the second rendering order. The first visual object and the second visual object may be rendered to generate a scene in the three-dimensional space.

In one embodiment, a method includes accessing a video; detecting one or more objects in one or more frames of the video; identifying one or more of the detected objects; determining a relevance score for each of the one or more of the identified objects with respect to a user the video is to be presented to; selecting one or more frames of the video based on the determined relevance scores for the identified objects in the frames; and providing for presentation to the user one or more of the selected frames of the video.

Video highlights

In one embodiment, a method for designing an augmented-reality effect may include associating an image with an anchor position that defines a first relative point in the image and a second relative point in a first display region. The image may be associated with a first position offset, which may be used to define a first position of the image relative to the display region based on the first and second relative points. Information associated with the image may be stored in files, which may be configured to cause the image to be displayed at a second position in a second display region. A third relative point in the second display region may be defined by the anchor position. The first position offset may be used to define the second position of the image relative to the second display region based on the first and third relative points.

Visual editor for designing augmented-reality effects and configuring scaling parameters

In one embodiment, a method for designing an augmented-reality effect may include displaying, by a computing device, a video within a user interface. The video may comprise an object, such a person's face. The object may be associated with a tracker in response to a first instruction from a user. The tracker may be displayed in the video and may be configured to move according to movements of the object. An augmented-reality object may be associated with the tracker in response to a second instruction from the user. The augmented-reality object may be displayed in the video and may be configured to move according to movements of the tracker. Then, one or more defined relationships between the tracker and the augmented-reality object may be stored in one or more files.

In one embodiment, a method for designing an augmented-reality effect may include receiving a model definition of a virtual object. The virtual object may be rendered in a 3D space based on the model definition. The system may display the virtual object in the 3D space from a first perspective in a first display area of a user interface. The system may display the virtual object in the 3D space from a second perspective, different from the first, in a second display area of the user interface. The system may receive a user command input by a user through the first display area for adjusting the virtual object. The virtual object may be adjusted according to the user command. The system may display the adjusted virtual object in the 3D space from the first perspective in the first display area and from the second perspective in the second display area.

Growing community of inventors

London, United Kingdom

Stef Marc Smet