Snap Inc.

Snapchat, Inc.

Kirk Ouimet

Haibo Zhao

Kameron Sheffield

Nathan Kenneth Boyd

Yunchao Gong

Ryan Hornberger

Landon Anderton

Garrett Gee

Benjamin Turley

Omer Cansizoglu

Xing Mei

Zhuangtian Zhao

Evan Spiegel

Yu Hu

Jeremy Baker Voss

Rong Yan

Ebony James Charlton

Yantao Zheng

Newar Husam Al Majid

Chamal Samaranayake

Sheldon Chang

Nan Hu

Chongyang Ma

Trevor Denton

Caleb Ogden

Ning Xu

Jonathan Dale Brody

Rahul Bhupendra Sheth

Jaewook Chung

Xin Chen

Manny Jerrold Adler

Jinhua Jiang

Ike Z Adler

Christopher Jonathan Luc

Glenne Christiaansen

Timothy Michael Sehn

Celia Nicole Mourkogiannis

Kaveh Anvaripour

Gabriel Lupin

Swetha Krishna Prabhakar

In some embodiments, a method of processing image data may include receiving environmental data and associated capture time data from a sensor of a mobile computing device, the capture time data reflecting capture time of the environmental data; processing the environmental data to generate metadata; time stamping the metadata using the capture time data; receiving video data and video time data at a processor; correlating the metadata to the video data using the capture time data and the video time data; receiving a search query; and/or identifying a frame within the video data by performing a search of the metadata using the search criterion.

System to correlate video data and contextual data

A system and method for presentation of computer vision (e.g., augmented reality, virtual reality) using user data and a user code is disclosed. A client device can detect an image feature (e.g., scannable code) in one or more images. The image feature is determined to be linked to a user account. User data from the user account can then be used to generate one or more augmented reality display elements that can be anchored to the image feature in the one or more images.

Coded vision system

Systems and methods for guided personal identity based actions are provided. In example embodiments, a user-specified action from a first user device of a first user is received. The user-specified action pertains to the first user and uses data of the first user when performed. The user-specified action is linked to an identifier. An indication of the identifier is received from a second user device of a second user. In response to receiving the indication of the identifier, the user-specified action linked to the identifier is identified, the data of the first user is accessed, a user interface that includes an option to perform the user-specified action using the data of the first user is generated, and the generated user interface is presented on the second user device.

Guided personal identity based actions

Systems, methods, devices, server computers, storage media, and instructions for prioritized device action triggered by device scan data are described. In one embodiment, a mobile device performs a method that involves executing a messaging application with an image capture interface and a scanning input. An associated scanning mode comprises capture of scan data from a plurality of input/output modules of the first client device, analyzes the scan data to identify one or more scan data patterns by matching at least a portion of the scan data against a set of data patterns, and selects a priority system action based on the results of the matching of the portion of the scan data against the set of data patterns. In some embodiments, the priority system action is selected based on a priority ranking for identified scan data types.

Prioritized device actions triggered by device scan data

Systems and methods are provided receiving, from a computing device associated with a first user of a content sharing platform, a request to access a second user profile associated with a second user in the content sharing platform, accessing activity data related to both the first user and the second user in the content sharing platform, determining common activity data to both the first user and the second user, wherein the common activity data comprises at least one media content item generated by the second user that was viewed or saved by the first user, or one or more datum saved by the first user from a communication received from the second user, and generating second user profile data comprising the common activity data related to both the first user and the second user in the content sharing platform as part of the second user profile.

Content sharing platform profile generation

In other embodiments, a method to perform image-based searching may include receiving a group of images from a content owner; creating an index using the group of images; receiving a further image from a mobile computing device of a user; determining a correlation between the further image and the index; and/or directing the mobile computing device of the user to content of the content owner, responsive to the determining of the correlation.

Redirection to digital content based on image-search

A data package is received from a plurality of devices. Each data package comprises audio content captured by a respective device from the plurality of devices. Each data package further comprises metadata including a location of the respective device when the audio content was captured and a time at which the audio content was captured. A subset of the data packages that include audio content captured within a specified geographic area and within a specified time period is identified based on the metadata. A playlist for the specified area and the specified time period is generated based on the subset of data packages. The playlist may be provided to at least a first device.

Geolocation based playlists

Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by enabling users to generate customized media overlays that can be shared with other users. For example, media overlays can be generated by the system and displayed in conjunction with media content (e.g., images and/or video) generated by an image-capturing device (e.g., a digital camera). In some embodiments, existing media overlays may be used by users to create derivative media overlays. The system may track usage of media overlays and any derivatives created based thereon, and allow users to control the distribution and use of their overlays in future derivatives. In some embodiments, for example, a user can modify an overlay they created and cause the modification to propagate to all derivative overlays based on the user's overlay.

Customized media overlays

Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by determining topics of electronic communications between users and generating customized media content items based on such topics. The media content can be generated for a variety of topics and shared with other users. For example, media content (e.g., images or video) can be generated and displayed on a user's computing device, as well as transmitted to other users via electronic communications, such as short message service (SMS) or multimedia service (MMS) texts and mails.

Customized contextual media content item generation

A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.

Media overlay selection system

Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.

Synthesizing cloud stickers

Systems and methods for custom functional patterns for optical barcodes are provided. In example embodiments, image data of an image is received from a user device. A candidate shape feature of the image is extracted from the image data. A determination is made that the shape feature satisfies a shape feature rule. In response to the candidate shape feature satisfying the shape feature rule, a custom graphic in the image is identified by comparing the candidate shape feature with a reference shape feature of the custom graphic. In response to identifying the custom graphic, data encoded in a portion of the image is decoded.

Custom functional patterns for optical barcodes

A messaging server system receives audio data packages from a plurality of client devices. Each audio data package includes audio content captured by a respective client device from the plurality of client devices, and location data describing a location of the respective client device when the audio content was captured. The messaging server system identifies, based on the location data included in the audio data packages, a subset of the audio data packages that include audio content captured within a predetermined geographic area. The messaging server system generates, based on the subset of the audio data packages, a playlist of audio content items for the predetermined geographic area, and provides the playlist of audio content items to at least a first client device.

Growing community of inventors

Orem, UT, United States of America

Kirk Ouimet