Vmware, Inc.

Mansi Shah

Christian Dickmann

Christos Karamanolis

Nathan Burnett

Eric Shannon Knauft

Pascal Renauld

Subramanian Neelakantan

Vishnu Rajula

Wenguang Wang

Jin Zhang

William John Earl

Ye Zhang

Varun A Shah

Tao Xie

Yu Wu

Zongliang Li

Radhika Vullikanti

Ojan Thornycroft

Enning Xiang

Yiqi Xu

Yi Yang

Gopala Suryanarayana

Peng Dai

Yizhou Luo

Pratik Shridhar Desai

Zhihao Yao

Niket Kandya

Chaitanya Datye

Santhosh Sreenivasaiah

An example virtualized computing system includes a cluster of hosts having a virtualization layer executing thereon and configured to manage virtual machines (VMs); a local storage device in a first host of the cluster, the local storage device configured as direct-attach storage; and an orchestration control plane, integrated with the virtualization layer, the orchestration control plane including a master server managing state of the orchestration control plane, the state including objects representing the hosts and the VMs, the orchestration control plane deploying a persistent application executing on a first VM of the VMs, the persistent application storing persistent data on the direct-attach storage.

Direct access storage for persistent services in a virtualized computing system

The disclosure herein describes enhancing data durability of a base component using a delta component. A delta component is generated based on the base component becoming unavailable. The delta component is configured to include unwritten storage space with an address space matching the base component and a tracking bitmap associated with data blocks of the address space of the delta component. Write operations targeted for the base component are routed to the delta component. Based on the routed write operations, bits associated with data blocks affected by the write operations are changed in the tracking bitmap. Based on the base component becoming available, data blocks affected by routed write operations are identified based on the tracking bitmap and the identified data blocks are synchronized from the delta component to the base component. The delta component is then removed.

Synchronizing a stale component of a distributed object using a delta component during maintenance

An example virtualized computing system includes a cluster of hosts having a virtualization layer executing thereon and configured to manage virtual machines (VMs); first and second local storage devices in a first host, the first local storage device being part of a virtual storage area network (vSAN) and the second local storage device being exclusive of the vSAN; and an orchestration control plane, integrated with the virtualization layer and including a master server managing state of the orchestration control plane, the state including objects representing the hosts and the VMs, the orchestration control plane deploying a persistent application executing on a first VM, the persistent application storing persistent data on the second local storage device; and a virtualization management server configured to manage the cluster and to cooperate with the orchestration control plane to modify the state to notify the master server of a virtual infrastructure (VI) event.

Direct access storage for persistent services in a distributed storage system

The disclosure provides an approach for fault tolerance handling. Embodiments include determining, by a management component, that a host stores data relating to a service. Embodiments include receiving, by the management component, fault tolerance information from the service, the fault tolerance information comprising first information about host failures tolerated by the service and second information about existing host failures related to the service. Embodiments include determining, by the management component, based on the fault tolerance information from the service, whether the service will tolerate the host becoming unavailable. Embodiments include performing, by the management component, one or more actions based on the determining of whether the service will tolerate the host becoming unavailable.

Fault tolerance handling for services

Techniques are described for storing a virtual disk in an object store comprising a plurality of physical storage devices housed in a plurality of host computers. A profile is received for creation of the virtual disk wherein the profile specifies storage properties desired for an intended use of the virtual disk. A virtual disk blueprint is generated based on the profile such that that the virtual disk blueprint describes a storage organization for the virtual disk that addresses redundancy or performance requirements corresponding to the profile. A set of the physical storage devices that can store components of the virtual disk in a manner that satisfies the storage organization is then determined.

Virtual disk blueprints for a virtualized storage area network utilizing physical storage devices located in host computers

Techniques for predicting the outcome of a storage management operation on a hyper-converged infrastructure (HCI) deployment are provided. In one set of embodiments, a computer system can retrieve a current storage resource state of the HCI deployment. The computer system can then execute a simulation of the storage management operation in view of the current storage resource state, where the executing includes performing one or more simulated data movements between one or more host systems in the HCI deployment. Upon completing the simulation, the computer system can generate a report including, among other things, a predicted result status of the storage management operation based on the simulation.

Hyper-converged infrastructure (HCI) operation predictor

Embodiments presented herein techniques for balancing a multidimensional set of resources of different types within a distributed resources system. Each host computer providing the resources publishes a status on current resource usage by guest clients. Upon identifying a local imbalance, the host computer determines a source workload to migrate to or from the resources container to minimize the variance in resource usage. Additionally, when placing a new resource workload, the host computer selects a resources container that minimizes the variance to further balance resource usage.

Load balancing of resources

Example methods are provided for unbalanced storage resource usage configuration for a distributed storage system in a virtualized computing environment. An example method may include obtaining usage data associated with multiple storage resources forming the distributed storage system. The multiple storage resources are supported by the multiple hosts. Based on the usage data, the method may further include determining a higher usage set and a lower usage set of one or more storage resources from the multiple storage resources and configuring the multiple hosts to use the multiple storage resources in an unbalanced manner by using the higher usage set of one or more storage resources at a higher usage level compared to the lower usage set of one or more storage resources.

Unbalanced storage resource usage configuration for distributed storage systems

The disclosure herein describes mounting a shared data store, remote from a client cluster, as a remote data store on the client cluster. An abstraction interface of the remote data store on the client cluster is configured to receive data operations that are in a local data store-based format. A control path interface is established between the server cluster and the client cluster, and network location data associated with the shared data store is received by the client cluster via the established control path interface. Based on the network location data, a data path interface is established between the client cluster and the shared data store of the server cluster, whereby data operations directed to the abstraction interface of the remote data store on the client cluster are routed to the shared data store of the server cluster via the established data path interface.

Mounting a shared data store of a server cluster on a client cluster for use as a remote data store

Creating, by host computers, respective object of virtual disk based on virtual disk blueprint

Techniques for implementing access pattern-based distribution of key-value content in a distributed key-value store comprising a plurality of nodes are provided. In one set of embodiments, a node in the plurality of nodes can receive a request to create a key-value entry. The node can further determine whether the key-value entry is associated with a first (e.g., global) scope or a second (e.g., local) scope. If the key-value entry is associated with the first scope, the node can cause the key-value entry to be replicated on every node in the plurality of nodes. On the other hand, if the key-value entry is associated with the second scope, the node cause the key-value entry to be stored solely on that node.

Access pattern-based distribution for distributed key-value stores

The disclosure herein describes reconfiguring a data object in a data store using batch portions of components of the data object. Instructions to reconfigure the data object to a target object layout are received, the data object including a concatenation layer that references a plurality of components. The components are grouped into batch portions and the batch portions are reconfigured in a series based on the received instructions. The reconfiguring for each batch portion includes allocating free storage space according to the target object layout as target components, copying the data stored in the batch portion to the target components, redirecting references in the concatenation layer from the components of the batch portion to the target components, and releasing storage space occupied by the components of the batch portion. As a result, storage space used as transient capacity during the reconfiguring is reduced to a size of the batch portions.

Reconfiguring data objects using batch processing of concatenated components

Example methods are provided for unbalanced storage resource usage configuration for a distributed storage system in a virtualized computing environment. The method may comprise: obtaining usage data associated with multiple storage resources forming the distributed storage system; and based on the usage data, determining a higher usage set and a lower usage set from the multiple storage resources. The method also comprise configuring the multiple hosts to use the multiple storage resources in an unbalanced manner by using the higher usage set at a higher usage level compared to the lower usage set.

Growing community of inventors

Palo Alto, CA, United States of America

Mansi Shah