The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 23, 2024

Filed:

Sep. 09, 2020
Applicant:

Nvidia Corporation, Santa Clara, CA (US);

Inventors:

Santosh Kumar Ravindranath Shukla, Maharashtra, IN;

Andrew Currid, Alameda, CA (US);

Chenghuan Jia, Fremont, CA (US);

Arpit R. Jain, Maharashtra, IN;

Shounak Santosh Deshpande, Maharashtra, IN;

Assignee:

NVIDIA Corporation, Santa Clara, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 9/455 (2018.01); G06N 3/04 (2023.01); G06N 3/08 (2023.01); A63F 13/30 (2014.01);
U.S. Cl.
CPC ...
G06F 9/45558 (2013.01); G06N 3/04 (2013.01); G06N 3/08 (2013.01); A63F 13/30 (2014.09); G06F 2009/45583 (2013.01);
Abstract

Systems and methods are disclosed for throttling memory bandwidth accessed by virtual machines (VMs). A technique for dynamically throttling the virtual computer processing units (vCPUs) assigned to a VM (tenant) controls the memory access rate of the VM. When the memory is shared by multiple VMs in a cloud-computing environment, one VM increasing its memory access rate may cause another VM to suffer memory access starvation. This behavior violates the principle of VM isolation in cloud computing. In contrast to conventional systems, a software solution for dynamically throttling the vCPUs may be implemented within a hypervisor and is therefore portable across CPU families and doesn't require specialized server-class CPU capabilities or limit the system configuration.


Find Patent Forward Citations

Loading…