Neureality Ltd.

Qualcomm Incorporated

Moshe Tanach

Yossi Kasus

Lior Khermosh

Udi Sivan

Assaf Touboul

Meir Tsadik

Amit Radzi

A method and system for communicating artificial intelligence (AI) tasks between AI resources are provided. The method includes establishing a connection between a first AI resource and a second AI resource; encapsulating a request to process an AI task in at least one request data frame compliant with a communication protocol, wherein the at least one request data frame is encapsulated at the first AI resource; transporting the at least one request data frame over a network using a transport protocol to the second AI resource, wherein the transport protocol is different than the communication protocol; and using a credit-based flow control mechanism to transfer messages between the first AI resource and the second AI resource over the transport protocol, thereby avoiding congestion on compute resources.

Communication protocol, and a method thereof for accelerating artificial intelligence processing tasks

A method and system for data transport of artificial intelligence (AI) tasks between AI resources are provided. The method includes establishing a connection between an AI client and an AI server with a storage element capabilities; encapsulating a request to process an AI task in a command capsule compliant with a storage data transfer protocol, wherein the command capsule is encapsulated at the AI client; and transporting the command capsule to an AI server over a transport link using the storage data transfer protocol.

Communication protocol for accelerating artificial intelligence processing tasks over non-volatile memory express protocol

A method and system for communicating artificial intelligence (AI) tasks for a server chaining are presented. The method includes establishing a first connection between an AI client and a first AI server; encapsulating a request to process an AI task in at least one request data frame compliant with a communication protocol; and transporting the at least one request data frame over a network using a transport protocol over the first connection to the first AI server, wherein the first AI server spans the AI task over at least one second AI server, wherein the transport protocol provisions transport characteristics of the AI task and the transport protocol is different than the communication protocol, wherein AI task includes processing of a single compute graph thereby allow spanning the processing of the compute graph over one more AI servers.

A remote artificial intelligence (AI) acceleration system is provided. The system includes a plurality of application servers, wherein each of the plurality of application server is configured to execute AI applications over an AI software framework; at least one artificial intelligence accelerator (AIA) appliance server configured to execute AI processing tasks in response to requests from the AI applications; and at least one switch configured to allow connectivity between the plurality of application servers and the at least one AIA appliance server, wherein the plurality of network attached artificial intelligence accelerator (NA-AIA) engines connected to the AIA switch, wherein each of the plurality of NA-AIA engines connected is configured to execute at least one processing AI task.

Remote artificial intelligence (AI) acceleration system

An artificial intelligence (AI) sequencer is provided. The Al sequencer includes a queue manager configured to manage a plurality of queues for maintaining data of AI jobs, wherein an AI job includes processing of one or more AI functions; a scheduler for scheduling execution of data maintained by the plurality of queues; a plurality of job processing units (JPUs), wherein each of the plurality JPUs is configured to at least generate an execution sequence for an AI job; and a plurality of dispatchers connected to a plurality of AI accelerators, wherein each of the plurality of dispatchers is configured to dispatch at least a function of the AI job to an AI accelerator, wherein a function is dispatched to an AI accelerator at an order determined by an execution sequence created for a respective AI job.

Method and system for sequencing artificial intelligence (AI) jobs for execution at AI accelerators

A system and method for communicating artificial intelligence (AI) tasks between AI resources are provided. The method comprises establishing a connection between a first AI resource and a second AI resource; encapsulating a request to process an AI task in at least one request data frame compliant with a communication protocol, wherein the at least one request data frame is encapsulated at the first AI resource; and transporting the at least one request data frame over a network using a transport protocol to the second AI resource, wherein the transport protocol provisions the transport characteristics of the AI task, and wherein the transport protocol is different than the communication protocol.

Apparatus and method for direct data transfer in a wireless broadband system having an operating system, the apparatus including a central processing unit (CPU), at least one dedicated Direct Memory Access unit (DMA) local to the CPU, coupled directly to the CPU, and a commands FIFO (First In First Out) receiving commands from the CPU and automatically transferring the commands in sequence to the DMA for implementation by the DMA, in the absence of intervention by the operating system.

Growing community of inventors

Bet Herut, Israel

Moshe Tanach