Snap Inc.

Ebony James Charlton

Celia Nicole Mourkogiannis

Andrew James McPhee

Kaveh Anvaripour

Nathan Kenneth Boyd

Daniel Moreno

Samuel Edward Hare

Kyle Goodrich

Michael John Evans

Dhritiman Sagar

Jokubas Dargis

Kevin Dechau Tang

Eitan Pilipski

Patrick Mandia

Travis Chen

Robert Cornelius Murphy

Kirk Ouimet

Zhou Ren

Sumant Milind Hanumante

Omer Cansizoglu

Ricardo Sanchez-Saez

Victor Shaburov

Daniel Vincent Grippi

Xing Mei

Gabriel Lupin

Hao Hu

Yanjia Li

Mykhailo Sokolov

Trevor Stephenson

Pedram Javidpour

Andrew James Mcphee

A media curation system configured to perform operations that include, capturing an image at a client device, wherein the image includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image at the client device.

Context based media curation

A modular image processing SDK comprises an API to receive API calls from third party software running on a portable device including a camera. SDK logic receives and processes commands and parameters received from the API that are based on the API calls received from the third party software. An annotation system performs image processing operations on a feed from the camera based on image processing instructions and parameters received by the annotation system from the SDK logic. The image processing is based at least in part on augmented reality content generator data (or AR content generators), user input and sensor data.

Software development kit for image processing

Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow virtual objects to be moved relative to a real-world environment and manipulated in other ways.

Three-dimensional interaction system

A dynamic media menu that comprises a media carousel to present collections of media content, and an 'Augmented-Reality (AR) bar' to receive inputs to identify a media category.

Dynamic media selection menu

Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.

Contextual media filter search

A system and method for presentation of computer vision (e.g., augmented reality, virtual reality) using user data and a user code is disclosed. A client device can detect an image feature (e.g., scannable code) in one or more images. The image feature is determined to be linked to a user account. User data from the user account can then be used to generate one or more augmented reality display elements that can be anchored to the image feature in the one or more images.

Coded vision system

A content display system can control which content and how the content is displayed based on viewing parameters, such as a map zoom level, and physical distance parameters, e.g., a geo-fence distance and an icon visibility distance. Different combinations of input (e.g., zoom level and physical distances) yield a myriad of pre-set content displays on the client device, thereby allowing a creator of an icon to finely tune how content displayed otherwise accessed.

Mobile-based cartographic control of display content

Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.

Selective identification and order of image modifiers

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.

Surface aware lens

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, from a first application running on a device, a request to switch to a second application on the device, the request identifying augmented reality content to display with image data captured by a camera of the device; providing, in response to receiving the request, for switching from the first application to the second application; providing for the second application to activate the camera to capture the image data; and providing for the second application to display the image data captured by the camera with the augmented reality content.

Displaying augmented reality content in messaging application

The technical problem of adding content that originates from a third party application to an augmented reality component maintained by a messaging server system is addressed by configuring the augmented reality component to modify content captured by a camera according to values of one or more attributes and by permitting delivery of said values, from the third party application to the messaging server system, in the payload of a deep link that references the identification of the augmented reality component.

Dynamic augmented reality components

A venue system of a client device can submit a location request to a server, which returns multiple venues that are near the client device. The client device can use one or more machine learning schemes (e.g., convolutional neural networks) to determine that the client device is located in one of specific venues of the possible venues. The venue system can further select imagery for presentation based on the venue selection. The presentation may be published as ephemeral message on a network platform.

Device location based on machine learning classifications

A contextual filter system configured to perform operations that include, capturing an image frame at a client device, wherein the image frame includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image frame, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image frame at the client device.

Dynamic contextual media filter

A user interface method is provided by an SDK embedded in a third party resource running on a portable device including a camera and a display. The method includes receiving an API call to display an image processing user interface and in response, displaying a first user interface comprising a list of selectable graphical items corresponding to a group of available image modification features. If user selection of a desired graphical item from the list of selectable graphical items is received, image modification features corresponding to the desired graphical item are applied to an image received from the camera, generating a modified image. A second user interface including the modified image is then displayed on the display.

Growing community of inventors

Santa Monica, CA, United States of America

Ebony James Charlton