Parallel Machines Ltd.

International Business Machines Corporation

Binaris Inc

Michael Adda

Avner Braverman

Gal Zuckerman

Lior Khermosh

Lior Amar

Dan Aloni

Eli Finer

Ariel Shaqed

System and methods for grouping tasks into groups, associating each of the groups with a respective isolated environment, pre-loading each the isolated environments with stand-by task-specific information of all the tasks in the group, and upon a request to activate one of the tasks, quickly activating the task in the respective isolated environment using the respective stand-by task-specific information already pre-loaded, while optionally clearing other stand-by task-specific information from the respective isolated environment, thereby efficiently executing the requested task while avoiding adverse interaction, inter-group and intra-group, between the tasks, and while also saving system resources by avoiding an allocating of a dedicated isolated environment per each of the tasks. Tasks may be grouped such as to reduce the likelihood of intra-group adverse interaction or to reduce the consequences of such adverse interaction.

Systems and methods for efficiently expediting execution of tasks in isolated environments

System and methods for receiving requests for executing specific tasks, analyzing current computational resources available for executing the tasks, and selecting code segments for executing the tasks, in which the selection of the code segments is done in a way that optimizes allocation of the various computational resources among the tasks, and such that said optimization is directed and facilitated by taking into consideration constraints and guidelines associated with the requests. Each of the tasks is associated with at least two code segments operative to execute the task, in which per a given task, different code segments operative to execute the task are associated with different computational resources needed for such execution. The selection of specific code segments in turn affects utilization of the computational resources. Guidelines such as latency requirements, cost constraints, and specific sources of code may be considered when selecting code segments in conjunction with resource availability.

Systems and methods for selecting specific code segments in conjunction with executing requested tasks

System and methods for intelligently directing a service request to a preferred place of execution. The services, which are executed by a unified client-server system, may be microservices associated with a microservice architecture, or other services in which a first entity sends a request to another entity to execute a certain service needed by the first entity. The unified client-server system may decide which services to execute on which of a plurality of different kinds of devices located in a variety of places. The decision may affect service request latency, network bandwidth, power consumption, and may optimize the task of transporting associated data components between the different entities in the system. The unified client-server system may be abstracted via a certain interface, such that the actual execution place of each of the services is controlled by the system and not necessarily by the requesting entity.

Systems and methods for intelligently directing a service request to a preferred place of execution

System and methods for on-demand isolated execution of specific tasks. A system receives, via a communication interface, requests to execute tasks. The system reacts to each of the requests by allocating, on-demand and per the request received, a unique sub-set of physical computational resources, so as to result in several such unique sub-sets of resources. The system executes, per each of the tasks, the respective commands of the task, by converting the respective commands of the task into executable instructions and running the executable instructions. The respective commands of each of the tasks are converted so as to cause the resulting executable instruction to refrain from accessing other unique sub-sets that were not allocated to the task, thereby facilitating said on-demand isolated execution of each of the tasks.

On-demand isolated execution of specific tasks

System and methods for receiving requests for executing tasks, executing the tasks while observing and gathering related performance levels, and using the observations to adapt execution of tasks to follow. The system adapts environments in which tasks are executed, thereby improving the ability of these environments to execute the tasks efficiently. As more performance data is available per a cretin type of tasks or per a specific task, the system gets closer to optimization. Performance may be affected by various parameters such as the particular execution environment used to executed the task, isolation techniques employed in keeping the tasks isolated from each other, actual code utilized for executing each of the tasks, and the usage of particular hardware components to facilitate related software. Environments, or combinations of various code and hardware components, that have proven inefficient in executing a certain task, will be replaced before executing similar tasks to follow.

Systems and methods for executing tasks adaptively

Two or more ports of a same type are identified in a computer. A separate device driver process is initiated for each of the identified ports. A one-to-one correspondence between each of the ports and each of the device driver processes is established.

Executing a kernel device driver as a user space process

Various embodiments of systems and methods to efficiently use a compute element to process a plurality of values distributed over a plurality of servers using a plurality of keys. In various embodiments, a system is configured to identify (or 'derive') the various server locations of various data values, to send requests to the various servers for the needed data values, to receive the data values from the various servers, and to process the various data values received. In various embodiments, requests are sent and data values are received via a switching network. In various embodiments, the servers are organized in a key value store, which may optionally be a shared memory pool. Various embodiments are systems and methods with a small number of compute elements and servers, but in alternative embodiments the elements may be expanded to hundreds or thousands of compute elements and servers.

Systems and methods for cache streams

Various systems and methods to achieve load balancing among a plurality of compute elements accessing a shared memory pool. The shared memory pool is configured to store and serve a plurality of data sets associated with a task, a first data interface's internal registry is configured to keep track of which data sets have been extracted from the shared memory pool and served to the compute elements, the first data interface is configured to extract from the shared memory pool and serve to the compute elements data sets which have not yet been extracted and served, the rate at which data sets are extracted and served to each particular compute element is proportional to the rate at which that compute element requests data sets, and the system may continues to extract, serve, and process data sets until all of the data sets associated with the task have been processed once.

Systems and methods to achieve load balancing among a plurality of compute elements accessing a shared memory pool

Various embodiments of systems and methods to allow and control simultaneous access and processing by multiple compute elements of multiple data sets stored in multiple memory modules. The compute elements request data to be processed without specifying any particular data sets to be received. Data interfaces receive the data requests from the compute elements, determine which data sets have not yet been served to the compute elements, select data sets to be served from among those that have not yet been served, and fetch these data sets from the memory modules. The process of requesting additional data by the compute elements, selection by the data interfaces of data sets to be served among those that have not yet been served, and providing such data sets by the data interfaces to the compute elements, may continue until all of the data sets have been served to the compute elements.

Systems and methods to distributively process a plurality of data sets stored on a plurality of memory modules

Described herein are systems and methods to process efficiently, according to a certain order, a plurality of data sets arranged in data blocks. In one embodiment, a first compute element receives from another compute element a first set of instructions that determine an order in which a plurality of data sets are to be processed as part of a processing task. Relevant data sets are then streamed into a cache memory associated with the first compute element, but the order of streaming is not by order of storage but rather by the order conveyed in the first set of instructions.

Systems and methods for processing data sets according to an instructed order

Various systems and methods to perform efficiently a first processing task in conjunction with a plurality of data sets. A first code sequence comprises a plurality of general commands, and a specific command including a description of a first data processing task to be performed in conjunction with the data sets. The general commands are received and processed in a standard manner. The specific command is identified automatically by its nature, and the description within the specific command is then converted into a first sequence of executable instructions executable by a plurality of compute elements holding the plurality of data sets. The ultimate result is an efficient implementation of the first processing task. In some embodiments, the implementation of the first processing task is assisted by a pre-defined procedure that allocates the data sets to the compute elements and shares instances of executable instructions with the compute elements.

Systems and methods for efficiently implementing functional commands in a data processing system

Described herein are systems and methods to prevent a controller in a DDIO (data direct input output) system from shifting currently-required data out of a cache memory. In one embodiment, a compute element disables caching of some specific addresses in a non-cache memory, but still enables caching of other addresses in the non-cache memory, thereby practically disabling the DDIO system, so that data sets not currently needed are placed in the addresses in the non-cache memory which are not cached. As a result, currently-required data are not shifted out of cache memory. The compute element then determines that the data sets, which formerly avoided being cached, are now required. The system therefore copies the data sets that are now required from addresses in non-cache memory not accessible to cache memory, to addresses in non-cache memory accessible to cache memory, thereby allowing the caching and processing of such data sets.

Utilizing a cache mechanism by copying a data set from a cache-disabled memory location to a cache-enabled memory location

A method, including receiving, by a user space driver framework (UDF) library executing from a user space of a memory over a monolithic operating system kernel, a kernel application programming interface (API) call from a device driver executing from the user space. The UDF library then performs an operation corresponding to the kernel API call.

Various systems and methods to generate automatically a procedure operative to distributively process a plurality of data sets stored on a plurality of memory modules. Under the instruction of the automatically generated procedure, compute elements request data sets relevant to a particular task, such data sets are fetched from memory modules by data interfaces which provide such data sets to the requesting compute elements, and the compute elements then process the received data sets until the task is completed. Relevant data sets are fetched and processed asynchronously, which means that the relevant data sets need not be fetched and processed in any particular order.

Systems and methods for automatic generation of parallel data processing code

Described herein are systems and methods to execute efficiently a plurality of actions, in which multiple actions require the use of a single data set. The data set is fetched from a data source, across a switching network, to a memory associated with a first compute element. This is the only fetching of the data set from the data source, and the only fetching across a switching network, thereby minimizing fetching across the switching network, reducing the load on the switching network, decreasing the time by which the data set will be accessed in second and subsequent processes, and enhancing the efficiency of the system. In some embodiments, processes are migrated from second and subsequent compute elements to the compute element in which the data set is stored. In some embodiments, second and subsequent compute elements access the data set stored in the memory associated with the first compute element.

Growing community of inventors

Dimona, Israel

Michael Adda