Emc Corporation

Emc IP Holding Company LLC

Panzura, Inc.

Jian Xing

Christopher Hercules Claudatos

Michael John Dutch

Mandavilli Navneeth Rao

Windsor Hsu

Akhil Kaushik

Rangarajan Suryanarayanan

Pu Paul Zhang

Qian Zhang

Subramaniam Periyagaram

Ajay Pratap Singh Kushwah

Pashupati Kumar

Mayank Joshi

Yogita Bijani

Stephen Smaldone

Hyong Shim

Anand Raj

Subramanian Periyagaram

The disclosed embodiments disclose techniques for accessing a scale-out block interface in a cloud-based distributed computing environment (CBDCE). During operation, an instance of a block device service (BDS) receives a data request from a client. The BDS instance translates the data request into a set of data block accesses, and then sends the translated data request to a data processing layer service (DPL). The DPL instance services the data request using a set of data operations that leverage one or more of a distributed cache, a distributed database, and a cloud storage system. The BDS service leverages the DPL instance to provide to the client an abstraction of a highly-available block storage device with unlimited storage space via the scale-out block interface.

Accessing a scale-out block interface in a cloud-based distributed computing environment

The disclosed embodiments disclose techniques for journaling data received in a cloud-based distributed computing environment (CBDCE). Multiple services simultaneously execute on the CBDCE compute nodes, with each service comprising multiple service instances that simultaneously execute on multiple, distinct compute nodes of the CBDCE. The CBDCE includes a distributed database that enables coordination between the service instances of services that execute in the CBDCE; this distributed database also includes multiple distributed database instances that simultaneously executing on multiple different CBDCE compute nodes. During operation, a service instance executing on one of these compute nodes receives a client request. The service instance submits this client request to a distributed database instance and, in parallel, also submits the client request and its associated user data to a distributed journaling service.

Journaling data received in a cloud-based distributed computing environment

The disclosed embodiments disclose techniques for managing a cloud-based distributed computing environment (CBDCE) that comprises multiple geographically-distributed compute nodes. Multiple services simultaneously execute on the CBDCE compute nodes, with each service comprising multiple service instances that simultaneously execute on multiple distinct compute nodes of the CBDCE. During operation, the system uses a distributed database to track the status of the CBDCE to ensure the ongoing stability and scalability of the CBDCE. Upon receiving a request that is associated with the configuration of the CBDCE, a service accesses CBDCE status information from the distributed database to respond to the request.

Managing a cloud-based distributed computing environment using a distributed database

The disclosed embodiments disclose techniques for managing a distributed cache in a cloud-based distributed computing environment (CBDCE). During operation, an instance of a data processing layer service (DPL) receives a data request from a client that specifies an address and an operation for a target data block. The DPL instance uses these to determine a first cache instance of the distributed cache that is assigned to cache a metadata entry that links the address with a data block fingerprint for the target data block. The DPL instance then uses the data block fingerprint and the cache mapping to determine a second cache instance that is assigned to store the target data block, and then accesses the second cache instance to complete the operation for the target data block.

Managing a distributed cache in a cloud-based distributed computing environment

The disclosed embodiments disclose techniques for managing cloud-based storage using a time-series database. A distributed cloud data management system (DCDMS) manages objects stored in a cloud storage system. The DCDMS leverages a distributed time-series database to track objects accessed via the DCDMS. During operation, the DCDMS receives a request to access an object using a path identifier and an object identifier. The DCDMS determines from the path identifier that the request is associated with one of its supported extended capabilities, and uses the previously tracked object operations that are stored in the time-series database to determine the actual target bucket in the cloud storage system that contains the requested object; the target bucket that contains the object may be different from the bucket identified in the path identifier that is received. The object identifier is then used to access the requested object from the target bucket to service the request.

Managing cloud-based storage using a time-series database

A method, article of manufacture, and apparatus for protecting data. In some embodiments, this includes receiving a changed block, reading a previous backup to get a file list in change block tracking, checking a file in a modified master file table list for a reference flag, wherein the modified master file table list is based on the changed block, and modifying a database entry based on the reference flag.

File deletion detection in key value databases for virtual backups

A method, article of manufacture, and apparatus for protecting data. In some embodiments, this includes taking a snapshot of a virtual machine, parsing the virtual machine to determine a header section and a file system, indexing the virtual machine based on the parsing, storing the index in a storage device, and storing the snapshot in a deduplicated data storage device.

Efficient backup of virtual data

A computer-implemented method for enhancing data protection is disclosed. The method starts with monitoring an operating status of a storage volume at a primary storage of a storage system, where the storage volume is allocated to one or more applications. The method continues with determining whether the operating status of the storage volume satisfies a predetermined condition and notifying a backup application to trigger a backup of the storage volume of the primary storage to a backup storage upon determining that the operating status of the storage volume satisfies the first predetermined condition.

Method and system for data protection based on storage status

Data protection is disclosed. A directory is used to identify keys in a key value database. Each identified key is walked through to identify values and a file is identified based on the walk through. The identified file is restored to a storage device.

Efficient file browsing using key value databases for virtual backups

A method, article of manufacture, and apparatus for protecting data. A file modification is identified. A previous file entry is modified where the previous file entry is stored in a key value database. A new file entry is created in the key value database. The previous file entry modification includes modifying the end version of the entry.

Updating key value databases for virtual backups

Files from a master file table are identified. A key/value database based on the identified files is generated where the key includes directory information and the value includes file metadata. The key/value database is stored in a storage device. Identifying files from a master file table includes parsing a VMDK to isolate a master file table region.

Key value databases for virtual backups

A computer-implemented proxy server local to a backup target system performs a backup method for a system supporting a plurality of virtual machines. The backup method includes receiving an initialization of a connection over a network from a backup server identifying the system to backup to the backup target system, establishing a communication connection over the network with the system to backup including identifying an interface for accessing data of the system to backup, receiving an image of the system to backup from the backup server, retrieving a data set corresponding to the image from the system to backup over the network, and writing the data set to a local file in the backup target system.

Dynamic proxy server assignment for virtual machine backup

A method, article of manufacture, and apparatus for protecting data. In some embodiments, this includes creating a copy of a backup virtual machine on a deduplicated data storage device, registering the copy with a virtual environment manager, operating a virtual machine based on the copy and storing changes made during operation of the virtual machine to the copy.

Virtual machine disaster recovery

A VM management server receives a request from a backup application server to back up a first VM. The VM management server determines a first of the host systems based on the request, wherein the first host system hosts the first VM. A first request is transmitted from the VM management server to a VMM of the first host system hosting the first VM via a VM application programming interface (VM API) over a network. The first request requests the VMM to capture a VM snapshot representing a consistent state of the first VM. In response to determining that the consistent state of the VM has been captured, a second request is transmitted to a first storage system associated with the first host system to send one or more VM disk images associated with the consistent state of the first VM to a second storage system over the network.

System and method for full virtual machine backup using storage system functionality

A method for information management comprises intercepting an output from an application; distributing packets according to a routing scheme, wherein the packets are associated with the output, and wherein distributing the packets may occur when the application is associated with a first operating system, and may also occur when the application is associated with a second operating system; and storing the packets.

Growing community of inventors

Pleasanton, CA, United States of America

Jian Xing