Matroid, Inc.

Twitter, Inc.

Reza Bosagh Zadeh

John Goddard

Deepak Menghani

Ryan Tobin

Dong Wang

Steven Chen

Xiaoyun Yang

Ryan Wong

Jiahang Li

Venumadhav Satuluri

Sebastian Schelter

Sebastian Scheiter

Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems comprise an integrated detection unit configured to record media content, identify preferred content, and communicate the identifications of preferred content for storage in a computationally efficient manner.

Detecting content in a real-time video stream recorded by a detection unit

Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems provide user interfaces that allow users to review search results, pinpoint relevant portions of media content items where the identified objects are determined to be present, review detector performance and retrain detectors, providing search result feedback, and/or reviewing video monitoring results and analytics.

Machine learning in video classification with playback highlighting

Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems and methods describe techniques that search videos and media content to determine the presence of unknown objects, generate novel detectors trained to identify the unknown objects, and apply the novel detectors to historical media content to identify previous appearances of the unknown objects.

Detecting content in a real-time video stream using machine-learning classifiers

Machine learning in video classification with schedule highlighting

A messaging system provides recommendations of content that account holders of the messaging system might be interested in engaging with. In order to determine what to recommend, the messaging system generates a model of account holder engagement behavior organized by type of engagement. The model parameters are trained on differences between expected engagement behavior based on past data and actual engagement behavior, and include a set of common factor matrices that are trained using data from more than on engagement type. As a consequence, engagement behavior of other account holders with respect to other types of engagements different than the one sought to be recommended serves as a partial basis for determining what engagements of the sought-after type are recommended.

Real time analyses using common features

Machine learning in video classification

Growing community of inventors

Palo Alto, CA, United States of America

Reza Bosagh Zadeh