Salesforce, Inc.

Ebay, Incorporated

Yuliya Feldman

Alexandr Nikitin

Seyedshahin Ashrafzadeh

Manoj Agarwal

Chirag Rajan

Swaminathan Sundaramurthy

Peter M Johnson

Zhenyin Yang

Manoj Kumar Agarwal

Vaibhav Gumashta

Shio-Hsien Hubert Tai

Sandeep Bhalla

Samuel Au

Mohana Fulay

A method performs service discovery in a machine learning service. The method includes detecting initialization of at least one service container, identifying label information in the at least one service container, collecting the label information for the initializing at least one service container, and storing the label information in a routing information storage to enable routing of requests to the at least one service container.

Discovery and routing to inference servers based on monitored version information

A method by one or more electronic devices to provision an infrastructure for a machine learning application in a multi-tenant on-demand serving infrastructure. The method includes storing a plurality of templates, wherein each of the plurality of templates indicates a scoring interface, a web server, a definition of a continuous integration pipeline, and a definition of a continuous deployment pipeline, receiving a request to provision the infrastructure for the machine learning application using a specified template from the plurality of templates, and provisioning the infrastructure for the machine learning application using the specified template to create a version control system repository, a continuous integration pipeline, and a continuous deployment pipeline.

Using templates to provision infrastructures for machine learning applications in a multi-tenant on-demand serving infrastructure

A method by one or more electronic devices for spinning up a scoring container on demand. The method includes receiving, from an orchestrator component via an application programming interface (API), a request to spin up the scoring container, wherein the scoring container is configured to provide scoring functionality, spinning up the scoring container responsive to receiving the request to spin up the scoring container, and providing, to the orchestrator component via the API, a response to the request to spin up the scoring container, wherein the response includes a uniform resource locator (URL) to use to submit scoring requests to the scoring container.

Application programming interface for spinning up machine learning inferencing server on demand

A machine learning serving infrastructure implementing a method of receiving or detecting an update of container metrics including resource usage and serviced requests per model or per container, processing the container metrics per model or per container to determine recent resource usage and serviced requests per model or per container, and rebalancing distribution of models to a plurality of containers to decrease a detected load imbalance between containers or a stressed container in the plurality of containers.

Configuration map based sharding for containers in a machine learning serving infrastructure

Machine learning version management method for a prediction service includes receiving a prediction request, determining application metadata for the request that defines routing logic and a machine learning framework version, determining model metadata for the request that defines at least one model and at least one model version, forwarding the prediction request to the at least one model with the at least one model version, and returning a prediction from the at least one model to a requestor.

Method and system for machine learning framework and model versioning in a machine learning serving infrastructure

A method and system for assessing VAT on marketing services provided via a network-based marketplace are disclosed. VAT is automatically assesses for users of the services having residences in different countries, at least a portion of which require VAT charges for the services. Corresponding data is stored at individual sites operated by the marketplace service. Periodically, VAT-related data are aggregated for each of the plurality of countries to generate respective tax return reports. VAT is accessed for different users based on the country of residence of the user and whether the user has a VAT-exempt status.

Growing community of inventors

Campbell, CA, United States of America

Yuliya Feldman