Amazon Technologies, Inc.

Scott Matthew King

Maury Richard Sponchia

Samatha Sudabattula

Russell William Mackenzie

Justin Wayne Callison

Diego Raphael Pedroza Santiviago

Daniel James Ronald

Feng Qiu

Jalandip Lepcha

System and methods are provided for dynamically parallelized large data set processing. A workflow includes a distributed map state. A set of steps in the distributed map state are run for each item in a collection of items or for each batch. Execution of the distributed map state is dynamically parallelized such that the system creates as many parallel workflows as there are items in the collection at run time (or batches). The items in the collection are dynamically determined by the workflow system, as defined by a resource in the distributed map state.

Dynamically parallelized workflow processing

At a cell manager external to a network-accessible service, a set of data associated with a first isolated cell of the service is obtained. Service requests representing respective subsets of the workload of the service are processed at respective cells, with each cell comprising a number of request processing nodes. The cell manager analyzes the set of data, and initiates a configuration change at the first isolated cell based on results of the analysis.

Cell management for services implemented at cloud computing environments

Growing community of inventors

Parksville, Canada

Scott Matthew King