Snap Inc.

Ibram Uppal

Jean Luo

Vincent Sung

Riccardo Boscolo

Erika Michele Kehrwald

Ruoyu Li

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing make-up based augmented reality content. The program and method provide for receiving a request to present augmented reality content in association with a captured image depicting a face of the user; accessing an augmented reality content item associated with applying makeup to the face and configured to generate a mesh for tracking plural regions of the face; receiving user input selecting a region; determining at least one of a range of color values or a range of contrast values relating to available makeup products for the selected region; and presenting an interface element in association with the face, the interface element for user selection of at least one of a color value within the range of color values or a contrast value within the range of contrast values.

Selecting color values for augmented reality-based makeup

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality-based makeup. The program and method provide for receiving a request to present augmented reality content in association with an image captured by a device camera, the image depicting a user's face; accessing an augmented reality content item applying makeup to the face, the augmented reality content configured to generate a mesh for tracking plural regions of the face and to present available makeup products with respect to the plural regions; presenting the augmented reality content item in association with the face depicted in the image; receiving user input selecting a region of the plural regions; determining a set of available makeup products corresponding to the selected region; and updating presentation of the augmented reality content item based on the set of available makeup products.

Providing augmented reality-based makeup in a messaging system

The subject technology requests a set of augmented reality (AR) content generators based on a group ID, generated by an extension application programming interface (API), using a camera API. The subject technology receives the set of AR content generators. The subject technology provides for display representations of the set of AR content generators in an interface. The subject technology receives a selection of a first AR content generator from the set of AR content generators. The subject technology renders the first AR content generator for display, using the camera API. The subject technology requests metadata for a set of products based on the selected first AR content generator using the extension API. The subject technology receives the metadata from the extension API. The subject technology provides for display the set of representations of products based on the received metadata.

Product cards provided by augmented reality content generators

The subject technology determines at least one primitive shape based on at least one graphical element in an augmented reality (AR) facial pattern. The subject technology generates a JavaScript Object Notation (JSON) file using at least one primitive shape. The subject technology generates internal facial makeup format (IFM) data using the JSON file.

Procedurally generating augmented reality content generators

The subject technology receives information for a product. The subject technology generates a 3D model file of the product in a first format. The subject technology converts the 3D model file to a 3D object file in a second format. The subject technology associates the 3D object file to the product in a product catalog service. The subject technology publishes an augmented reality (AR) content generator corresponding to the product.

Ingestion pipeline for generating augmented reality content generators

The subject technology identifies a set of graphical elements in an augmented reality (AR) facial pattern. The subject technology determines at least one primitive shape based on the set of graphical elements. The subject technology generates a JavaScript Object Notation (JSON) file using at least one primitive shape. The subject technology generates internal facial makeup format (IFM) data using the JSON file. The subject technology publishes the IFM data to a product catalog service.

Growing community of inventors

Woodland Hills, CA, United States of America

Ibram Uppal