Salesforce, Inc.

Chirag Rajan

Yuliya Feldman

Alexandr Nikitin

Manoj Agarwal

Seyedshahin Ashrafzadeh

Swaminathan Sundaramurthy

A method performs service discovery in a machine learning service. The method includes detecting initialization of at least one service container, identifying label information in the at least one service container, collecting the label information for the initializing at least one service container, and storing the label information in a routing information storage to enable routing of requests to the at least one service container.

Discovery and routing to inference servers based on monitored version information

A method by one or more electronic devices to provision an infrastructure for a machine learning application in a multi-tenant on-demand serving infrastructure. The method includes storing a plurality of templates, wherein each of the plurality of templates indicates a scoring interface, a web server, a definition of a continuous integration pipeline, and a definition of a continuous deployment pipeline, receiving a request to provision the infrastructure for the machine learning application using a specified template from the plurality of templates, and provisioning the infrastructure for the machine learning application using the specified template to create a version control system repository, a continuous integration pipeline, and a continuous deployment pipeline.

Using templates to provision infrastructures for machine learning applications in a multi-tenant on-demand serving infrastructure

A method by one or more electronic devices for spinning up a scoring container on demand. The method includes receiving, from an orchestrator component via an application programming interface (API), a request to spin up the scoring container, wherein the scoring container is configured to provide scoring functionality, spinning up the scoring container responsive to receiving the request to spin up the scoring container, and providing, to the orchestrator component via the API, a response to the request to spin up the scoring container, wherein the response includes a uniform resource locator (URL) to use to submit scoring requests to the scoring container.

Growing community of inventors

Burlingame, CA, United States of America

Chirag Rajan