Huawei Technologies Co., Limited

University of Toronto

Weidong Han

Feng Xie

Eyal De Lara

Graham Allsop

Yingdong Liu

Daniel Kats

Eyal Delara

The present disclosure provides systems, methods, and computer-readable media for managing graphics processing unit (GPU) allocation for a virtual machine (VM). A first GPU driver, associated with a first GPU, is offloaded from an operating system (OS) of the VM. Then, the first GPU is deallocated from the VM. A second GPU is allocated to the VM, and a second GPU driver, associated with the second GPU, is loaded in the OS of the VM. To restore a GPU context from the first GPU within the second GPU, a GPU command log from the first GPU is replayed to the second GPU.

Allocation of graphics processing units for virtual machines

A method for implementing GPU virtualization. The method is applied to a physical host and the physical host includes: a hardware layer including a GPU, a Host running on the hardware layer, and N back-end GPU Domains and M front-end VMs that run on the Host, where there are service channels between the N back-end GPU Domains and the M front-end VMs. The method includes: transferring, by an mfront-end VM, a GPU command to an nback-end GPU Domain based on the service channels; and processing, by the nback-end GPU Domain, the GPU command by using a GPU, to obtain corresponding processing result data, where the type of the operating systems running on the nback-end GPU Domain and the mfront-end VM is same. The invention helps to optimize performance of a GPU virtualization system.

Method for implementing GPU virtualization and related apparatus, and system

Growing community of inventors

Guangdong, China

Weidong Han