Snap Inc.

Kevin Dechau Tang

Celia Nicole Mourkogiannis

Jianchao Yang

Jia Li

Kaveh Anvaripour

Ebony James Charlton

Ning Xu

Yuke Zhu

Travis Chen

Hao Hu

Rahul Bhupendra Sheth

Ning Zhang

Linjie Yang

Xing Mei

Yanjia Li

Evan Spiegel

Nathan Kenneth Boyd

Gabriel Lupin

A media curation system configured to perform operations that include, capturing an image at a client device, wherein the image includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image at the client device.

Context based media curation

Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.

Content navigation with automated curation

A dynamic media menu that comprises a media carousel to present collections of media content, and an 'Augmented-Reality (AR) bar' to receive inputs to identify a media category.

Dynamic media selection menu

Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.

Contextual media filter search

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for updating an avatar status for a user of a messaging system. The program and method provide for receiving, by a messaging application running on a device of a user, a request to identify at least one object depicted in an image captured by a device camera; determining, in response to receiving the request, an attribute of an object depicted in the image; selecting, from plural candidate avatar poses for an avatar of the user, an avatar pose corresponding to an activity that relates to the attribute of the object; and displaying the selected avatar pose for the user.

Updating an avatar status for a user of a messaging system

Systems and methods are provided for performing operations including: receiving, via a messaging application, a request to scan an image captured by a camera of the user device; determining an attribute of an object depicted in the image; identifying, from a plurality of augmented reality items, an augmented reality item that is associated with the attribute of the object; combining the identified augmented reality item with the image captured by the camera; and displaying, via the messaging application, the image captured by the camera combined with the identified augmented reality item.

Augmented reality items based on scan

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for updating avatar clothing of a user of a messaging system. The program and method provide for receiving, by a messaging application running on a device of a user, a request to identify at least one object depicted in an image captured by a device camera; determining, in response to receiving the request, an attribute of an object depicted in the image; selecting, from plural candidate articles of clothing for an avatar of the user, an article of clothing that is associated with the attribute of the object; and displaying the selected article of clothing with the avatar of the user.

Updating avatar clothing for a user of a messaging system

A system according to various exemplary embodiments includes a processor and a user interface, communication module, and memory coupled to the processor. The memory stores instructions that, when executed by the processor, cause the system to: retrieve a digital image from a server using the communication module; present the digital image on a display of the user interface; receive edits to the digital image via the user interface; generate, based on the edits, a modified digital image, wherein generating the modified digital image includes transforming a format of the digital image to include a field containing an identifier associated with the modified digital image; and transmit the modified digital image to the server using the communication module.

Systems and methods for digital image editing

A contextual filter system configured to perform operations that include, capturing an image frame at a client device, wherein the image frame includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image frame, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image frame at the client device.

Dynamic contextual media filter

Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

Automated content curation and communication

Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

Automated image processing and content curation

Systems and methods provide for receiving a request for an alternate data stream of a plurality of individual data streams than an active data stream currently being displayed on a computing device, during display on the computing device of a stitched data steam comprising the plurality of individual data streams associated with a common audio timeline. The systems and methods further providing for determining a subset of the plurality of individual data streams of the stitched data stream associated with a time period of the active data stream in the common audio timeline, selecting the alternate data stream from the subset of the plurality of individual data streams, and providing the alternate data stream to the computing device, wherein the display of the active data stream on the computing device transitions to the alternate data stream on the computing device in the common audio timeline.

Generating a stitched data stream

Systems and methods are provided for performing operations including receiving, via a messaging application, a request to scan an image captured by a camera of the user device; determining an attribute of an object depicted in the image; identifying, from a plurality of augmented reality items, an augmented reality item that is associated with the attribute of the object; combining the identified augmented reality item with the image captured by the camera; and displaying, via the messaging application, the image captured by the camera combined with the identified augmented reality item.

Growing community of inventors

Los Angeles, CA, United States of America

Kevin Dechau Tang