Amazon Technologies, Inc.

Justin Wayne Callison

Maury Richard Sponchia

Scott Matthew King

Russell William Mackenzie

Diego Raphael Pedroza Santiviago

Daniel James Ronald

Feng Qiu

Jalandip Lepcha

System and methods are provided for dynamically parallelized large data set processing. A workflow includes a distributed map state. A set of steps in the distributed map state are run for each item in a collection of items or for each batch. Execution of the distributed map state is dynamically parallelized such that the system creates as many parallel workflows as there are items in the collection at run time (or batches). The items in the collection are dynamically determined by the workflow system, as defined by a resource in the distributed map state.

Dynamically parallelized workflow processing

Growing community of inventors

Vancouver, Canada

Justin Wayne Callison