Snap Inc.

Alek Matthiessen

Jean Luo

Celia Nicole Mourkogiannis

Virginia Drummond

Christine Barron

Jonathan Solichin

Olesia Voronova

Kaveh Anvaripour

Ilteris Kaan Canberk

Erika Michele Kehrwald

Vincent Sung

Maxwell Gale

Charles Melbye

Oleksandr Chepizhenko

Yichuan Wang

Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

Augmented reality beauty product tutorials

Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.

Adding beauty products to augmented reality tutorials

The subject technology selects a set of augmented reality content generators from a plurality of augmented reality content generators. The subject technology causes display, at a client device, of a graphical interface comprising a plurality of selectable graphical items. The subject technology receives, at the client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item comprising a first augmented reality content generator corresponding to a particular geolocation. The subject technology causes display, at the client device, at least one augmented content reality item generated by the first augmented reality content generator. The subject technology causes display, at a second client device, the at least one augmented content reality item generated by the first augmented reality content generator, the at least one augmented content reality item comprising the 3D scene based at least in part on the particular geolocation.

Augmented reality content generators for spatially browsing travel destinations

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content corresponding to a translation in association with travel. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; obtaining, in response to receiving the request, a travel parameter associated with the request, and an attribute of an object depicted in the image; determining, based on the travel parameter and the attribute, to perform a translation with respect to the object; performing, in response to the determining, the translation with respect to the object; and displaying an augmented reality content item, which includes the translation, with the image.

Augmented reality-based translations associated with travel

The subject technology causes, at a client device, display of a graphical interface comprising a plurality of selectable graphical items, each selectable graphical item corresponding to a respective content item associated with a different geolocation. The subject technology receives, at the client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item corresponding to a particular geolocation. The subject technology causes display, at the client device, a second plurality of selectable graphical items, each of the second plurality of selectable graphical items corresponding to a particular second geolocation of an activity or place of business within a geographical area associated with the particular geolocation.

Interfaces to organize and share locations at a destination geolocation in a messaging system

Systems, methods, and computer readable media for augmented reality beauty product tutorials are disclosed. Methods disclose displaying on a first portion of a screen a beauty product tutorial including pre-recorded images of a presenter applying a beauty product to a body part of the presenter and determining first effects indicating changes to make to live images of a user to simulate applying the beauty product to the body part of the user, where the first effects are determined based on second effects indicating changes to the pre-recorded images from applying the beauty product to the body part of the presenter. Methods further disclose processing the live images of the user to add the first effects and indications of motion of the beauty product and displaying the processed live images of the user on a second portion of the screen.

The subject technology receives, at a client device, a selection of a first selectable graphical item, the first selectable graphical item comprising a first augmented reality content generator corresponding to a particular geolocation. The subject technology causes display, at the client device, of a graphical interface comprising a plurality of selectable augmented reality content items, each selectable augmented reality content item corresponding to a particular activity based at in part on the particular geolocation. The subject technology receives, at the client device, a second selection of a particular selectable augmented reality content item from the plurality of selectable augmented reality content items. The subject technology causes display, at the client device, at least one second augmented reality content item generated by the first augmented reality content generator, the at least one second augmented content item comprising a three-dimensional (3D) scene based at least in part on the particular geolocation.

Augmented reality content generator for suggesting activities at a destination geolocation

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content in association with travel. The program and method provide for receiving, by a messaging application, a request to perform a scan operation in association with an image captured by a device camera; determining a travel parameter associated with the request and an attribute of an object depicted in the image; selecting an augmented reality content item based on at least one of the travel parameter or the attribute, the augmented reality content item being configured to present augmented reality content based on speech input; receiving the speech input; obtaining at least one of a transcription or translation of the speech input; and presenting the augmented reality content item, including the transcription or translation, in association with the image.

Augmented reality-based translation of speech in association with travel

In one or more implementations, usage of augmented reality content items may be tracked based on characteristics of respective target audiences of the augmented reality content items. User tracking components may be included with respective instances of the augmented reality content items that analyze characteristics of users of the client application access the augmented reality content items in relation to the characteristics of the target audiences.

Tracking usage of augmented reality content across multiple users

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content with a captured image in association with traveling, in accordance with some example embodiments. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; determining, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image; obtaining supplemental content based on the travel parameter and on the attribute; and displaying an augmented reality content item, which includes the supplemental content, with the captured image.

Providing travel-based augmented reality content with a captured image

The subject technology causes display, at the client device, a set of augmented reality content items generated by the first augmented reality content generator. The subject technology receives, at the client device, a second selection of the particular augmented reality content item corresponding to the destination geolocation. The subject technology causes display, at the client device, a second set of augmented reality content items generated by the first augmented reality content generator. The subject technology receives, at the client device, a second selection of the second set of augmented reality content items. The subject technology causes display, at the client device, a third set of augmented reality content items generated by the first augmented reality content generator, the third set of augmented reality content items comprising at least one activity or location associated with the destination geolocation and a selected period of time.

Augmented reality content generators for identifying destination geolocations and planning travel

The amount of user activity performed in relation to a promotion may be tracked based on user content captured via the client application. At least a portion of user content captured via the client application may be scanned and analyzed to identify user activity related to the user content. Augmented reality content items may be executable to generate content that is displayed in relation to the user content and that indicates an amount of user activity related to the promotion. In addition, the augmented reality content items may be executable to generate content in relation to the user content that indicates one or more redemption options for the promotion based on an amount of user activity performed by a user of the client application that captured the user content.

Augmented reality content items to track user activity and redeem promotions

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content relating to user-submitted reviews in association with traveling, in accordance with some example embodiments. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; determining, in response to receiving the request, a travel parameter associated with the request and an attribute of an object depicted in the image; selecting, from among plural candidate user interfaces relating to user-submitted reviews, a user interface that corresponds to the travel parameter and the attribute; and displaying an augmented reality content item, which includes the selected user interface, with the image.

Growing community of inventors

Marina Del Rey, CA, United States of America

Alek Matthiessen