Snap Inc.

Travis Chen

Kaveh Anvaripour

Celia Nicole Mourkogiannis

Ebony James Charlton

Kevin Dechau Tang

Gabriel Lupin

Yurii Monastyrshyn

Oleksii Kholovchuk

Artem Yerofieiev

Denys Makoviichuk

Artem Gaiduchenko

Bohdan Pozharskyi

Jianchao Yang

Samuel Edward Hare

Tony Mathew

Ning Zhang

Yuncheng Li

Jonathan Solichin

Pedram Javidpour

A media curation system configured to perform operations that include, capturing an image at a client device, wherein the image includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image at the client device.

Context based media curation

A dynamic media menu that comprises a media carousel to present collections of media content, and an 'Augmented-Reality (AR) bar' to receive inputs to identify a media category.

Dynamic media selection menu

Method for generating a live streaming video having real-time special effects starts with a processor displaying on a display device a lens selection user interface including a plurality of lens selections. The lens selections are associated with a plurality of special effects, respectively, and include a first lens selection associated with a first special effect and a second lens selection associated with a second special effect. The processor then receiving a selection of the first lens selection and applies in real-time the first special effect to a video stream captured by a camera to generate a video stream having the first special effect. The processor then transmits in real-time the video stream having the first special effect via a network to be displayed on a plurality of client devices. Other embodiments are disclosed.

Generating a live streaming video having real-time special effects

Method for triggering changes to real-time special effects included in a live streaming video starts with a processor transmitting in real-time a video stream captured by a camera via a network. The processor causes a live streaming interface that includes the video stream to be displayed on the plurality of client devices. The processor receives a trigger to apply one of a plurality of special effects to the video stream and determines a first special effect of the plurality of special effects is associated with the trigger. The processor applies in real-time the first special effect to the video stream to generate a video stream having the first special effect and transmits in real-time the video stream having the first special effect via the network. The processor causes the live streaming interface that includes the video stream having the first special effect to be displayed on the plurality of client devices. Other embodiments are disclosed.

Triggering changes to real-time special effects included in a live streaming video

A contextual filter system configured to perform operations that include, capturing an image frame at a client device, wherein the image frame includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image frame, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image frame at the client device.

Dynamic contextual media filter

Systems and methods are provided for performing operations including: receiving, via a messaging application, input that selects a collection of augmented reality items; obtaining an identifier of the collection of the augmented reality items; searching, based on the identifier, a plurality of augmented reality items to identify a subset of augmented reality items associated with the identifier; causing the messaging application to present the subset of augmented reality items; and causing the messaging application to modify an image based on a first augmented reality item in the subset.

Augmented reality item collections

Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.

Neural network-based image stream modification

Systems and methods are provided for generating content. The systems and methods include operations for: identifying a content item generation template that is associated with instructions for generating a content item; displaying, by a messaging application, an identifier of the content item generation template; receiving, by the messaging application, input that selects the identifier of the content item generation template; retrieving, by the messaging application, a plurality of content items associated with the content item generation template, each of the plurality of content items having been previously generated by a respective user of a plurality of users of the messaging application in accordance with the instructions associated with the content item generation template; and displaying, by the messaging application, the retrieved plurality of content items associated with the content item generation template.

Growing community of inventors

Los Angeles, CA, United States of America

Travis Chen