Snap Inc.

Christine Barron

Celia Nicole Mourkogiannis

Virginia Drummond

Alek Matthiessen

Jean Luo

Kaveh Anvaripour

Jonathan Solichin

Olesia Voronova

Ranidu Lankage

Christie Marie Heikkinen

Newar Husam Al Majid

Ryan Chan

Bertrand Saint-Preux

Shoshana Sternstein

Nathan Kenneth Boyd

Daniel Moreno

Wayne Mike Cao

Laurent Desserrey

David Phillip Taitz

Dallin Dyer

Sherif Mohamed

Shannon Ward

Isabelle Albi

Tabari Williams

Andrew Grosvenor Cooper

Gabriel Lupin

Amar Boghani

Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

Augmented reality beauty product tutorials

A permission based media system to perform operations that include: presenting a first media object at a client device associated with a user account, the first media object including a reference that identifies the user account; receiving an input that selects the first media object from the client device; determining a permission of the user account based on the reference that identifies the user account; presenting a set of options based on the permission associated with the user account; receiving a selection of an option from among the set of options; and generating a second media object based on the first media object and the selection of the option, according to certain embodiments.

Permission based media composition

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing audio with captured video clips. The program and method provide for displaying, by a messaging application, a capture user interface for capturing video; providing a camera mode selection element which is selectable to switch between a first camera mode for capturing a single video clip and a second camera mode for capturing multiple video clips, to generate a media content item; providing an audio selection element which is selectable to select an audio track for the media content item; receiving, via the camera mode selection element, first user input selecting the second camera mode; receiving, via the audio selection element, second user input selecting the audio track; and providing for capturing multiple video clips in association with the selected audio track for generating the media content item.

Selecting an audio track in association with multi-video clip capture

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for adding time-based captions to captured video. The program and method provide for displaying, by a messaging application, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item; switching, in response to first user input selecting the interface element, to the captions user interface which is configured to receive user input for caption content and a duration to display the caption content; receiving, via the captions user interface, second user input for the caption content and the duration; and generating the media content item based on the caption content and the duration to display the caption content.

Adding time-based captions to captured video within a messaging system

Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.

Adding beauty products to augmented reality tutorials

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for trimming video in association with multi-video clip capture. The program and method provide for displaying a capture user interface in accordance with a camera mode configured to capture multiple video clips for combining to generate a media content item; capturing the multiple video clips based on first user input received via the capture user interface, which includes a preview button selectable to navigate to a preview user interface for previewing and editing the multiple video clips; receiving, via the capture user interface, second user input selecting the preview button; and displaying, in response to the receiving, the preview user interface with a preview bar including a respective thumbnail for each of the multiple video clips, the preview bar being selectable to individually trim one or more of the multiple video clips.

Trimming video in association with multi-video clip capture

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for trimming video. The program and method provide for providing a capture user interface for capturing a video to generate a media content item; displaying a preview user interface for previewing and editing the captured video to generate the media content item, the preview user interface including an interface element for selecting to trim the captured video or to set a playback option for the media content item; receiving, via the interface element, user input selecting to trim the captured video; and displaying a preview bar within the preview user interface, the preview bar including a set of frames of the captured video and front and back handles respectively positioned in front and in back of the set of frames, each of the front and back handles being selectable to trim video.

Trimming video within a messaging system

Systems, methods, and computer readable media for augmented reality beauty product tutorials are disclosed. Methods disclose displaying on a first portion of a screen a beauty product tutorial including pre-recorded images of a presenter applying a beauty product to a body part of the presenter and determining first effects indicating changes to make to live images of a user to simulate applying the beauty product to the body part of the user, where the first effects are determined based on second effects indicating changes to the pre-recorded images from applying the beauty product to the body part of the presenter. Methods further disclose processing the live images of the user to add the first effects and indications of motion of the beauty product and displaying the processed live images of the user on a second portion of the screen.

The technical problem of enhancing the quality of an image captured in low light conditions by a front facing camera is addressed by providing an adaptive front flash system. An adaptive front flash system automatically adjusts configuration parameters of an overlaid view that operates in lieu of a front flash, termed a front flash view. The configuration parameters are adjusted based on characteristics of the output of the digital image sensor of the front facing camera. Examples of configuration parameters of the front flash view include one or more of brightness of the display, color temperature of the front flash view, and transparency of the front flash view.

Adaptive front flash view

The technical problem of enhancing the quality of an image captured by a front facing camera in low light conditions is addressed by displaying the viewfinder of a front facing camera with an illuminating border, termed a viewfinder ring flash. A viewfinder ring flash acts as a ring flash in low light conditions. A viewfinder ring flash may be automatically generated and presented in the camera view user interface (UI) when the digital sensor of a front facing camera detects a low light indication based on intensity of incident light detected by the digital image sensor of the camera.

Viewfinder ring flash

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing different camera modes. The program and method provide for displaying, by a messaging application, a capture user interface for capturing video according to a first camera mode for capturing a single video clip to generate a media content item; providing, by the messaging application, a camera mode selection element within the capture user interface, the camera mode selection element being selectable to switch from the first camera mode to a second camera mode for capturing multiple video clips for combining to generate the media content item; receiving, via the capture user interface, user input selecting the camera mode selection element; and updating, by the messaging application and in response to receiving the user input, the capture user interface for video capture according to the second camera mode.

Camera mode for capturing multiple video clips within a messaging system

The technical problem of automatically reprocessing an image captured by a camera in a manner that produces a personalized result is addressed by providing a customized image reprocessing system powered by machine learning techniques. The customized image reprocessing system is configured to automatically reprocess an image on a pixel level using a machine learning model that takes, as input, the image represented by pixel values, sensor data detected by the digital sensor of a camera at the time the image was captured, and, also, flash calibration parameters previously generated for that specific user.

Growing community of inventors

Los Angeles, CA, United States of America

Christine Barron