Snap Inc.

Celia Nicole Mourkogiannis

Jean Luo

Kaveh Anvaripour

Virginia Drummond

Alek Matthiessen

Ebony James Charlton

David Phillip Taitz

Patrick Mandia

Nathan Kenneth Boyd

Christine Barron

Kevin Dechau Tang

Christie Marie Heikkinen

Jonathan Solichin

Olesia Voronova

Travis Chen

Ilteris Kaan Canberk

Edward Koai

Benedict Copping

Charles Melbye

Jeremy Baker Voss

Evan Spiegel

Newar Husam Al Majid

Donald Giovannini

Nathaniel Parrott

Andrew Grosvenor Cooper

Chinmay Lonkar

Yamill Antonio Vallecillo

Nayana Samaranayake

Matthew Lee Cook

Ty Giacalone

Zachary Lupei

Yue Hu

Brian Yee

Dongguang Zhao

Jiawen Zeng

Jong-Hwi Lee

Chiung-Fu Shih

Timothy Kautz

Lu Lu

Zuoyou Gu

Wenbin Chen

Alex Beltyukov

David Zak Lipowicz

Ibrahem Shekoni

Laurent Desserrey

Daniel Moreno

David Meisenholder

Gabriel Lupin

Erika Michele Kehrwald

Mai Chi Tran

Grygoriy Kozhemiak

Joseph Timothy Fortier

Jacob Catalano

Luis Tueros-Grimaldo

Jacob Trefethen

Guillaume Sabran

Andrew James McPhee

Kyle Goodrich

Vincent Sung

Hao Hu

Oleksandr Grytsiuk

Ivan Golub

Mariya Apanovych

Yansong Liu

Siqi Chen

Mykhailo Sokolov

Khoi Tran

Benjamin Lo

Jonathan Dale Brody

Kirk Ouimet

Haibo Zhao

Swetha Krishna Prabhakar

Andrew James Mcphee

Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

Augmented reality beauty product tutorials

A media curation system configured to perform operations that include, capturing an image at a client device, wherein the image includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image at the client device.

Context based media curation

A modular image processing SDK comprises an API to receive API calls from third party software running on a portable device including a camera. SDK logic receives and processes commands and parameters received from the API that are based on the API calls received from the third party software. An annotation system performs image processing operations on a feed from the camera based on image processing instructions and parameters received by the annotation system from the SDK logic. The image processing is based at least in part on augmented reality content generator data (or AR content generators), user input and sensor data.

Software development kit for image processing

In one or more implementations, augmented reality content items may be executable to indicate locations of contacts of a user within a camera user interface that is showing content being captured by one or more cameras of a client device. The locations of the contacts may be indicated by representations of the contacts (e.g., avatars) within the camera user interface. The positions of the representations of the contacts within the camera user interface may indicate the locations of the contacts relative to the location of the user of the client device. Navigational tools may also be provided to direct the user of the client device to the location of one or more of the contacts.

Augmented reality content to locate users within a camera user interface

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for modifying a captured image. The program and method provide for displaying, by a messaging application, an image captured by a device camera; providing, by the messaging application, a user interface for selecting from among a plurality of content modifiers to modify the image, the plurality of content modifiers including a first content modifier corresponding to a machine learning model trained with a plurality of image pairs, each image pair including a first image and a second image corresponding to a modified version of the first image; receiving user selection of the first content modifier from among the plurality of content modifiers; determining, in response to receiving the user selection, a modified version of the image based on output from the machine learning model; and displaying the modified version of the image.

Machine learning-based modification of image content

The subject technology receives image data including a representation of a physical item. The subject technology analyzes the image data to determine an object corresponding to the physical item. The subject technology identifies a set of colors corresponding to a set of regions of the determined object. The subject technology analyzes second image data to detect a second object corresponding to a representation of a particular body part of a user. The subject technology generates augmented reality content based at least in part on the identified set of colors and the detected second object. The subject technology causes display, at a client device, the augmented reality content applied to the detected second object.

Augmented reality experiences of color palettes in a messaging system

The subject technology receives image data including a representation of a physical item. The subject technology analyzes the image data to determine an object corresponding to the physical item. The subject technology extracts product metadata based on the determined object. The subject technology sends, to a server, the product metadata to determine second product metadata associated with the product metadata. The subject technology receives, from the server, the second product metadata, the second product metadata including additional information related to the physical item. The subject technology causes display, at a client device, the additional information related to the physical item based at least in part on the second product metadata.

Identification of physical products for augmented reality experiences in a messaging system

A dynamic media menu that comprises a media carousel to present collections of media content, and an 'Augmented-Reality (AR) bar' to receive inputs to identify a media category.

Dynamic media selection menu

In one or more implementations, user interfaces may be generated that include user interface elements that enable the tracking or monitoring of interactions with augmented reality content by users of a client application. Usage metrics for augmented reality content may be collected and analyzed. In addition, information about client application users that interact with augmented reality content may be generated. In one or more examples, characteristics of users of the client application that interact with one or more augmented reality content items may be analyzed to determine a user characterization for one or more augmented reality content items. The usage metrics and user characterizations for augmented reality content items may be presented via a dashboard that is accessible to creators of augmented reality content.

Analyzing augmented reality content usage data

A classification based notification system is disclosed which performs operations that include: accessing user profile data associated with a user account associated with a client device, the user profile data including a list of user connections; designating a notification type to a portion of the list of user connections, the notification type corresponding to an alert attribute; receiving a notification from a user connection from among the portion of the list of user connections at the client device; and presenting an alert based on the alert attribute that corresponds with the notification type associated with the portion of the list of user connections at the client device.

User classification based notification

In one or more implementations, information about a number of products may be obtained. Visual effects corresponding to each product may be applied to objects included in user content to change the appearance of the objects included in the user content. Augmented reality content may be implemented to cause changes to the appearance of one or more objects included in the user content. In various examples, a number of visual effects related to different products may be applied to objects included in the user content. A user interface including information about each of the products applied to objects included in the user content may be produced.

Generating augmented reality content based on user-selected product data

A system to provide users with a means for accessing media content directly, by performing operations that include: causing display of a media item within a graphical user interface at a client device, the graphical user interface including a set of graphical elements; receiving a selection of a graphical element from among the set of graphical elements within the graphical user interface; generating a reference to the media item based on the selection of the graphical element; encoding a matrix barcode with the reference to the media item; and generating a presentation of the media item that includes a display of the matrix barcode at a position within the media item.

Encoded image based messaging system

A permission based media system to perform operations that include: presenting a first media object at a client device associated with a user account, the first media object including a reference that identifies the user account; receiving an input that selects the first media object from the client device; determining a permission of the user account based on the reference that identifies the user account; presenting a set of options based on the permission associated with the user account; receiving a selection of an option from among the set of options; and generating a second media object based on the first media object and the selection of the option, according to certain embodiments.

Permission based media composition

Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.

Adding beauty products to augmented reality tutorials

A carousel module that enables a user of an application to access related entities which may be friends where the friends are friends to the user within a messaging system. The carousel module accesses profile information of the friends from the messaging system and makes the profile information available within the application. The carousel module provides new functions related to friends for the user within the application. Methods include a carousel module accessing from a messaging system a list of friends of a user of an application, the list of friends indicating friends of a user within the messaging system. The methods include causing a carousel to be displayed for the user on a computing device and causing a status within the application of the friends of the carousel to be displayed on the computing device.

Messaging system with a carousel of related entities

Growing community of inventors

Los Angeles, CA, United States of America

Celia Nicole Mourkogiannis