Amazon Technologies, Inc.

Deepthi Chelupati

Jacob Adam Gabrielson

Joseph Elmar Magerramov

Joshua Marc Burgin

Mikhail Danilov

Dylan Owen Marriner

Joby Sky Lafky

Sean Tyler Myers

David Nasi

Suganya Rajendran

Abhijeet Pradeep Tirthgirikar

Systems and methods are described for a multi-tenant mode of a serverless code execution system. For instance, a method may include maintaining a set of execution environments, wherein each execution environment is associated with a serverless function, wherein the serverless function is associated with a software as a service (SaaS) provider that is a tenant of a cloud services provider, wherein the SaaS provider provides services to sub-tenants, wherein the set of execution environments are partitioned based on sub-tenants of the SaaS provider; receiving a call to execute a serverless function, wherein the call includes a serverless function identifier and a sub-tenant identifier; identifying a sub-tenant-specific execution environment of the set of execution environments that is associated with the sub-tenant; and in response to identifying the tenant-specific execution environment, invoking the serverless function on the sub-tenant-specific execution environment.

Multi-tenant mode for serverless code execution

A method for launching a plurality of computing instances may include obtaining a request to launch a plurality of computing instances. The request may indicate a first number and a target number of compute instances that is larger than the first number. The method may further include verifying that there is sufficient capacity, for example of a compute instance service, to launch at least the first number of compute instances. The request may be fulfilled by at least launching at least the first number of compute instances in a way that bypasses a rate limit that limits a rate at which compute instances can be launched. In some cases, the method may additionally include launching additional compute instances, as they become available, until the target number has been reached.

Large scale compute instance launching

Growing community of inventors

Seattle, WA, United States of America

Deepthi Chelupati