Vmware, Inc.

Xiangdong Che

Qi Liu

Jin He

Xiangjun Song

Sheng Fang

Bing Niu

Yu Wang

Li He

Junfeng Wang

An example method of offloading a compute task to an accelerator by an application executing in a host cluster includes: sending, by an application executing in an initiator host, the compute task to a virtual accelerator in the initiator host, the virtual accelerator paired with a hardware accelerator in a target host of the host cluster; forwarding, by the virtual accelerator, the compute task to the hardware accelerator in the target host over a network; and receiving, at the application via the virtual accelerator, a result of the compute task from the hardware accelerator over the network.

Virtual accelerators in a virtualized computing system

A computing environment can include a host system that maintains a guest system, and a hardware component configured to implement artificial intelligence ('AI') methods of processing and analyzing date. The guest system can provide a virtual computing environment that receives a request to implement an AI application, and utilize a framework and a guest library to convert data from the AI application into an intermediate representation (“IR”). The host system can receive the IR with a virtual device (“VD”), and utilize an IR backend to translate the IR into hardware operations for the hardware component. Translated hardware operations can be provided to, and carried out by, the hardware component to provide an implementation of the AI application. Results of the hardware operations can be transmitted from the VD of the host system to a VD driver of the guest system, virtualizing the hardware component relative to the guest system.

Virtualizing hardware components that implement AI applications

An example method of virtualizing a hardware accelerator in a host cluster of a virtualized computing system includes: commanding, at an initiator host in the host cluster, a programmable expansion bus device to reconfigure as a virtual accelerator based on specifications of a hardware accelerator in a target host of the host cluster; executing, in the programmable expansion bus device, software to emulate the virtual accelerator as connected to an expansion bus of the initiator host; receiving, at the programmable expansion bus device, compute tasks from an application executing in the initiator host; and sending, to the target host, the compute tasks for processing by the hardware accelerator.

System and methods for replicating and enforcing license information in a computer cluster are described. The method may include: receiving, by a core-node in the computer cluster, a plurality of peer-license-info from a plurality of peer-nodes selected from a plurality of cluster nodes. Each of the plurality of peer-license-info may include license-info collected by and associated with a corresponding one of the plurality of peer-nodes. The method may include generating, by the core-node, a first cluster-license-info based on the plurality of peer-license-info. The method may further include propagating, by the core-node, the first cluster-license-info to each of the plurality of peer-nodes. The first cluster-license-info is configured for detecting license violations among the plurality of cluster nodes.

Cluster-wise license information replication

A computing environment can include a host system that maintains a guest system, and a hardware component configured to implement artificial intelligence ('AI') methods of processing and analyzing date. The guest system can provide a virtual computing environment that receives a request to implement an AI application, and utilize a framework and a guest library to convert data from the AI application into an intermediate representation ('IR'). The host system can receive the IR with a virtual device (&#x201c;VD&#x201d;), and utilize an IR backend to translate the IR into hardware operations for the hardware component. Translated hardware operations can be provided to, and carried out by, the hardware component to provide an implementation of the AI application. Results of the hardware operations can be transmitted from the VD of the host system to a VD driver of the guest system, virtualizing the hardware component relative to the guest system.

Growing community of inventors

Beijing, China

Xiangdong Che