Rubrik, Inc.

Noel Moldvai

Jihang Lim

Prateek Pandey

Harish Raman Shanker

Milan Korsos

David Anthony Terei

Manjunath Chinni

Sagar Kashinath Honnungar

Fabiano C Botelho

Mudit Malpani

Methods and systems for improving data back-up, recovery, and search across different cloud-based applications, services, and platforms are described. A data management and storage system may direct compute and storage resources within a customer's cloud-based data storage account to back-up and restore data while the customer retains full control of their data. The data management and storage system may direct the compute and storage resources within the customer's cloud-based data storage account to generate and store secondary layers that are used for generating search indexes, to generate and store shared space layers and user specific layers to facilitate the deduplication of email attachments and text blocks, to perform a controlled restoration of email snapshots such that sensitive information (e.g., restricted keywords) located within stored snapshots remains protected, and to detect and preserve emails that were received or transmitted and then deleted between two consecutive snapshots.

Adaptable multi-layered storage for deduplicating electronic messages

Data management system with limited control of external compute and storage resources

Some examples relate generally to a data management platform comprising: a storage device configured to store secondary data and one or more processors in communication with the storage device and configured to perform certain operations. The operations may include identifying an aspect of the secondary data stored in the storage device, the secondary data including a backup of respective primary data stored in a primary data source; identifying or receiving an indication of a target to receive data associated with the identified aspect of the secondary data; and transmitting the data associated with the aspect of the secondary data to the target.

Data management platform

Adaptable multi-layer storage with controlled restoration of protected data

Some examples relate generally to a data management platform comprising a storage device configured to store secondary data and one or more processors in communication with the storage device and configured to perform certain operations. The operations may include identifying an aspect of the secondary data stored in the storage device, the secondary data including a backup of respective primary data stored in a primary data source; identifying or receiving an indication of a target to receive data associated with the identified aspect of the secondary data; and transmitting the data associated with the aspect of the secondary data to the target as a push transmission.

Methods and systems for allocating disk space and other limited resources (e.g., network bandwidth) for a cluster of data storage nodes using distributed semaphores with atomic updates are described. The distributed semaphores may be built on top of a distributed key-value store and used to reserve disk space, global disk streams for writing data to disks, and per node network bandwidth settings. A distributed semaphore comprising two or more semaphores that are accessed with different keys may be used to reduce contention and allow a globally accessible semaphore to scale as the number of data storage nodes within the cluster increases over time. In some cases, the number of semaphores within the distributed semaphore may be dynamically adjusted over time and may be set based on the total amount of disk space within the cluster and/or the number of contention fails that have occurred to the distributed semaphore.

Distributed semaphore with a different keys to reduce contention for dynamic reservation of disk space

Some examples relate generally to a data management platform comprising a storage device configured to store secondary data and one or more processors in communication with the storage device and configured to perform certain operations. The operations may include identifying an aspect of the secondary data stored in the storage device, the secondary data including a backup of respective primary data stored in a primary data source; identifying or receiving an indication of a target to receive data associated with the identified aspect of the secondary data; transmitting the data associated with the aspect of the secondary data to the target as a push transmission; and performing data management operations related to the secondary data subsequent to the push transmission.

Preservation of electronic messages between snapshots

Distributed semaphore with adjustable chunk sizes

Methods and systems for throttling per-node network bandwidths over time to maximize the aggregate bandwidth of a distributed cluster of nodes without exceeding a global bandwidth allowance for the entire cluster are described. The throttling of the individual node network bandwidths may include periodically adjusting individual node bandwidth settings for each node of a plurality of nodes within the cluster using node network interfaces. The adjusting of the individual node bandwidth settings for each node of the plurality of nodes may take into account the number and type of jobs running within the cluster at a particular point in time. The updates to the individual node bandwidth settings may be transmitted such that a first subset of the plurality of nodes with decreasing individual node bandwidth allocations are updated prior to updating a second subset of the plurality of nodes with increasing individual node bandwidth allocations.

Growing community of inventors

San Francisco, CA, United States of America

Noel Moldvai