Clarifai, Inc.

Clarifal, Inc.

Matthew Donald Zeiler

Adam L Berenzweig

Daniel Kantor

David Joshua Eigen

Christopher David Fox

John Rogers

Marshall Jones

Keith Ito

Christopher Yan

John W Sloan

Cassidy Williams

Jason Culler

Dalmo Cirne

Yanan Jian

Michael J Gormish

Ryan F Compton

Aviral Kulshreshtha

Jesse Rappaport

Samuel Dodge

Kevin Most

In some embodiments, a service platform that facilitates artificial intelligence model and data collection and collection may be provided. Input/output information derived from machine learning models may be obtained via the service platform. The input/output information may indicate (i) first items provided as input to at least one model of the machine learning models, (ii) first prediction outputs derived from the at least one model's processing of the first items, (iii) second items provided as input to at least another model of the machine learning models, (iv) second prediction outputs derived from the at least one other model's processing of the second items, and (v) other inputs and outputs. The input/output information may be provided via the service platform to update a first machine learning model. The first machine learning model may be updated based on the input/output information being provided as input to the first machine learning model.

Artificial intelligence model and data collection/development platform

Methods and computer readable media for facilitating training of a recognition model. An embodiment includes generating media items based on information associated with a representation of a graphic, the information including content other than the graphic, content based on at least one transformation parameter set, and content comprising the graphic integrated with the other content, then using a recognition model to process the media items to generate predictions related to recognition of the graphic for the media items, the generated predictions including an indication of a predicted location of the graphic in a first media item. The process also includes presenting an indication of the predicted location on an area of the first media item via a user interface to a user, then obtaining a reference feedback set that includes reference indications related to recognition of the graphic for the media items and including user feedback concerning the indication of the predicted location of the graphic, and then updating the recognition model based on the reference feedback.

System and method for facilitating graphic-recognition training of a recognition model

In certain embodiments, training of a neural network or other prediction model may be facilitated via live stream concept association. In some embodiments, a live video stream may be loaded on a user interface for presentation to a user. A user selection related to a frame of the live video stream may be received via the user interface during the presentation of the live video stream on the user interface, where the user selection indicates a presence of a concept in the frame of the live video stream. In response to the user selection related to the frame, an association of at least a portion of the frame of the live video stream and the concept may be generated, and the neural network or other prediction model may be trained based on the association of at least the portion of the frame with the concept.

Prediction model training via live stream concept association

A system for optimizing results of processed assets for provision to software applications based on determined sequences of operation is disclosed, the system having a cloud-based engine and a plurality of models that are each usable by the engine to provide artificial intelligence in connection with software applications. Multiple software extensions are executed by the engine in accordance with a respective model for at least one of the general-purpose software applications. Input data are processed as a function of at least one of the models and a set of the plurality of extensions, wherein a given sequence of executing the set of extensions on one of the inputs impacts results provided by the engine. The engine is configured by executing each of the extensions in different sequences to grade a respective degree of inference and selecting an optimum sequence, which is communicated to the general-purpose software application.

In-process engine implementation using SDK extensions

Systems, methods and computer program code to propose annotations are provided which include identifying an input, applying a grouping model to the input to predict at least a first grouping concept associated with the input, comparing the at least first grouping concept to a set of relationship data to select at least a first ranking model, applying the at least first ranking model to the input to predict at least a first ranking concept associated with the input, and causing a user interface to display the input, the at least first grouping concept and the at least first ranking concept to a user as proposed annotations of the input.

System and method for proposing annotations

In some embodiments, user-selectable/connectable model representations may be provided via a user interface to facilitate artificial intelligence development. The model representations may comprises first and second machine learning model (ML) representations corresponding to first and second ML models, and non-ML model representations corresponding to non-ML models. Based on user input indicating selection of the first and second ML model representations and a non-ML model representation corresponding to a non-ML model, at least a portion of a software application may be generated such that the software application comprises (i) an instance of the first ML model, an instance of the second ML model, and an instance of the non-ML model and (ii) an input/output data path between the instance of the first ML model and at least one other instance, the at least one other instance comprising the instance of the second ML model or the instance of the non-ML model.

Artificial intelligence development via user-selectable/connectable model representations

A system for browsing, searching and/or viewing video content includes at least one user device and a server computer operably connected to the at least one user device. The server computer includes at least one processor operably connected to an electronic storage device, and the at least one processor is programmed with computer program instructions that, when executed, cause the server computer to present a first video on a user interface to the at least one user device, wherein the user interface presents scenes of the first video and semantic labels associated with the scenes of the first video, and wherein the user interface further presents confidence parameters associated with the scenes of the first video and the semantic labels. The server computer also obtains, during presentation of a first scene of the first video, a selection of a semantic label from a user of the at least one user device, then causes, during the presentation of the first scene of the first video, a jump from the first scene to a second scene of the first video based on the selection of the semantic label, the second scene being associated with the selected semantic label, and the jump from the first scene to the second scene causing the second scene to be presented on the user interface, and then updates the presentation of the semantic labels and the confidence parameters based on the jump from the first scene to the second scene such that the updated presentation of the semantic labels and the confidence parameters on the user interface are associated with the second scene.

User interface for labeling, browsing, and searching semantic labels within video

In some embodiments, reduction of computational resource usage related to image labeling and/or segmentation may be facilitated. In some embodiments, a collection of images may be used to train one or more prediction models. Based on a presentation of an image on a user interface, an indication of a target quantity of superpixels for the image may be obtained. The image may be provided to a first prediction model to cause the prediction model to predict a quantity of superpixels for the image. The target quantity of superpixels may be provided to the first model to update the first model's configurations based on (i) the predicted quantity and (ii) the target quantity. A set of superpixels may be generated for the image based on the target quantity, and segmentation information related to the superpixels set may be provided to a second prediction model to update the second model's configurations.

Model-based image labeling and/or segmentation

In certain embodiments, training of a prediction model (e.g., recognition or other prediction model) may be facilitated via a training set based on one or more logos or other graphics. In some embodiments, graphics information associated with a logo or graphic (e.g., to be recognized via a recognition model) may be obtained. Media items (e.g., images, videos, etc.) may be generated based on the graphics information, where each of the media items includes (i) content other than the logo and (ii) a given representation of the logo integrated with the other content. In some embodiments, the media items may be processed via the recognition model to generate predictions (related to recognition of the logo or graphic for the media items). The recognition model may be updated based on (i) the generated predictions and (ii) corresponding reference indications (related to recognition of the logo for the media items).

Systems and methods for browsing, searching, and/or viewing video with associated semantic labels via a user interface are presented herein. Presentation of a user interface may be effectuated. The user interface may be configured to display scenes of one or more videos and/or one or more semantic labels associated with the scenes. A first scene associated with a first video and a first semantic label associated with the first scene may be displayed in the user interface. Playback of the first video in the user interface may cause one or more changes in the display of semantic labels over time, such that responsive to playback of the first video including display of a second scene after the first scene, a second semantic label is displayed and the first semantic label is no longer displayed. The second semantic label may be associated with the second scene.

In certain embodiments, content items may be obtained, where each of the content items may include multiple data types. Machine learning models may be caused to be trained based on the content items to map data in a vector space by providing at least a first portion of each of the content items as input to at least one of the machine learning models and providing at least a second portion of each of the content items as input to at least another one of the machine learning models. A search request for results may be obtained, where the search request includes search parameters. One or more locations within the vector space may be predicted (e.g., by one or more of the machine learning models) based on the search parameters. Information (indicating content items mapped to or proximate the predicted locations) may be provided as a request response.

Prediction-model-based mapping and/or search using a multi-data-type vector space

In certain embodiments, a neural network may be trained to associated context information with multimedia items. In some embodiments, context predictions for multimedia items may be obtained via a neural network. A first multimedia item and a first task related to a first context prediction for the first multimedia item may be presented on a user interface. A user response to the first task may be obtained via the user interface. Based on the user response to the first task, prediction feedback related to the first context prediction or the first multimedia item may be provided to the neural network to cause the neural network to be updated based on the prediction feedback.

User interface for context labeling of multimedia items

A system configured for learning new trained concepts used to retrieve content relevant to the concepts learned. The system may comprise one or more hardware processors configured by machine-readable instructions to obtain one or more digital media items. The one or more hardware processors may be further configured to obtain an indication conveying a concept to be learned from the one or more digital media items. The one or more hardware processors may be further configured to receive feedback associated with individual ones of the one or more digital media items. The one or more hardware processors may be configured to obtain individual neural network representations for the individual ones of the one or more digital media items. The one or more hardware processors may be configured to determine a trained concept based on the feedback and the neural network representations of the one or more digital media items.

Growing community of inventors

Fort Lee, NJ, United States of America

Matthew Donald Zeiler