Snap Inc.

Vincent Sung

Jean Luo

Riccardo Boscolo

Ashley Michelle Wayne

Ibram Uppal

Bogdan Maksymchuk

Oleksandr Chepizhenko

Per Sandell

Celia Nicole Mourkogiannis

Andrew James McPhee

Daniel Moreno

Kyle Goodrich

Kaveh Anvaripour

Alek Matthiessen

Maxwell Gale

Erika Michele Kehrwald

Yichuan Wang

Ruoyu Li

Yuliia Khoryshko

Evelina Yatselenko

Serhii Dehtiarov

Stiven Deleur

Alona Kotliar

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing make-up based augmented reality content. The program and method provide for receiving a request to present augmented reality content in association with a captured image depicting a face of the user; accessing an augmented reality content item associated with applying makeup to the face and configured to generate a mesh for tracking plural regions of the face; receiving user input selecting a region; determining at least one of a range of color values or a range of contrast values relating to available makeup products for the selected region; and presenting an interface element in association with the face, the interface element for user selection of at least one of a color value within the range of color values or a contrast value within the range of contrast values.

Selecting color values for augmented reality-based makeup

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality-based makeup. The program and method provide for receiving a request to present augmented reality content in association with an image captured by a device camera, the image depicting a user's face; accessing an augmented reality content item applying makeup to the face, the augmented reality content configured to generate a mesh for tracking plural regions of the face and to present available makeup products with respect to the plural regions; presenting the augmented reality content item in association with the face depicted in the image; receiving user input selecting a region of the plural regions; determining a set of available makeup products corresponding to the selected region; and updating presentation of the augmented reality content item based on the set of available makeup products.

Providing augmented reality-based makeup in a messaging system

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality-based makeup. The program and method provide for receiving, by a messaging application running on a device of a user, a request to present augmented reality content in association with an image captured by a device camera, the image depicting a face of the user; accessing an augmented reality content item configured to generate a plurality of completed looks with respect to applying makeup to the face; presenting the augmented reality content item, including the plurality of completed looks, in association with the face depicted in the image; receiving user input selecting a completed look of the plurality of completed looks; and displaying, in response to receiving the user input, an interface with a set of makeup products associated with the selected completed look.

Method, device, and non-transitory computer-readable storage medium for providing augmented reality-based makeup product sets in a messaging system

Usage metrics for augmented reality content may be identified and analyzed to determine measures of fitness for respective usage metrics. The measures of fitness may indicate a level of correlation with an outcome specified by an augmented reality content creator and an amount of interaction with an augmented reality content item by users of a client application. Recommendations may be provided to augmented reality content creators indicating modifications to augmented reality content items that have at least a threshold probability of increasing the level of interaction between users of the client application and the augmented reality content item.

Analyzing augmented reality content item usage data

Augmented reality content item templates may be used to generate augmented reality content items that are executable to display content corresponding to products offered for purchase to users of a client application. The augmented reality content item templates may include regions that may be populated according to information related to individual products. In this way an augmented reality content item template may be used to generate augmented reality content items that are customized based on the information about the individual products. The augmented reality content item templates may be classified according to a classification system such that augmented reality content item templates corresponding to a respective classification may be used to generate augmented reality content items for products that also correspond to the respective classification.

Methods, systems, and one or more non-transitory computer-readable storage media including templates to generate augmented reality content items that display product information

The subject technology requests a set of augmented reality (AR) content generators based on a group ID, generated by an extension application programming interface (API), using a camera API. The subject technology receives the set of AR content generators. The subject technology provides for display representations of the set of AR content generators in an interface. The subject technology receives a selection of a first AR content generator from the set of AR content generators. The subject technology renders the first AR content generator for display, using the camera API. The subject technology requests metadata for a set of products based on the selected first AR content generator using the extension API. The subject technology receives the metadata from the extension API. The subject technology provides for display the set of representations of products based on the received metadata.

Product cards provided by augmented reality content generators

In one or more implementations, usage of augmented reality content items may be tracked based on characteristics of respective target audiences of the augmented reality content items. User tracking components may be included with respective instances of the augmented reality content items that analyze characteristics of users of the client application access the augmented reality content items in relation to the characteristics of the target audiences.

Tracking usage of augmented reality content across multiple users

A method of generating an augmented reality lens comprises: causing to display a list of lens categories on a display screen of a client device; receiving a user choice from the displayed list; causing to prepopulate a lens features display on the display device based on the user choice, wherein each lens feature comprises image transformation data configured to modify or overlay video or image data; receiving a user selection of a lens feature from the prepopulated lens display; receiving a trigger selection that activates the lens feature to complete the lens; and saving the completed lens to a memory of a computer device.

Messaging system with augmented reality messages

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, from a first device associated with a first user, a first request to submit a media content item for viewing, the media content item corresponding to display of a first image, captured by the first device, with an augmented reality content item, the first request including an identifier of the augmented reality content item; storing the media content item together with the identifier of the augmented reality content item; providing, to a second device associated with a second user, the media content item; receiving, from the second device, a second request to identify the augmented reality content item; and providing, to the second device, the identifier of the augmented reality content item.

Growing community of inventors

Los Angeles, CA, United States of America

Vincent Sung