The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jul. 08, 2025
Filed:
Jun. 28, 2021
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Muthian Sivathanu, Chennai, IN;
Atul Katiyar, Sammamish, WA (US);
Dharma Kiritkumar Shukla, Bellevue, WA (US);
Rimma Vladimirovna Nehme, Bellevue, WA (US);
Shreshth Singhal, Seattle, WA (US);
Pankaj Sharma, Redmond, WA (US);
Nipun Kwatra, Bangalore, IN;
Ramachandran Ramjee, Bengaluru, IN;
Microsoft Technology Licensing, LLC., Redmond, WA (US);
Abstract
The disclosure herein describes scheduling execution of artificial intelligence (AI) workloads in a cloud infrastructure platform. A global scheduler receives AI workloads associated with resource ticket values. The scheduler distributes the AI workloads to nodes based on balancing resource ticket values. Local schedulers of the nodes schedule AI workloads on resources based on the resource ticket values of the AI workloads. Based on scheduling the AI workloads, coordinator services of the local schedulers execute the distributed AI workloads on the infrastructure resources of the nodes. The disclosure further describes scheduling AI workloads based on priority tiers. A scheduler receives AI workloads, and each AI workload is associated with a priority tier indicative of a preemption priority while being executed. The AI workloads are scheduled for execution on a distributed set of nodes based on the priority tiers and then execute based on the scheduling.