Google Inc.

Kyle Nesbit

Andrew Everett Phelps

Jacob Adriaens

Scott Fredrick Diehl

Scott Robert Finley

Manoj Kasichainula

Jacob Thomas Adriaens

A distributed storage system including memory hosts and at least one curator in communication with the memory hosts. Each memory host has memory, and the curator manages striping of data across the memory hosts. In response to a memory access request by a client in communication with the memory hosts and the curator, the curator provides the client a file descriptor mapping data stripes and data stripe replications of a file on the memory hosts for remote direct memory access of the file on the memory hosts.

Single-sided distributed storage system

A distributed storage system includes memory hosts, a curator, and a cache manager. Each memory host includes remote direct memory accessible non-transitory memory and a network interface controller that is in communication with the memory. The network interface controller services remote direct memory access requests. The curator communicates with the memory hosts, manages striping of a file amongst the memory hosts, and generates a file descriptor for the file that maps the striping of the file to corresponding storage locations on memory hosts. In addition, the cache manager stores copies of file descriptors generated by the curator in the memory of the memory hosts for remote direct memory access by a client in communication with the memory hosts.

Accessing data on distributed storage systems

A distributed storage system that includes memory hosts. Each memory host includes non-transitory memory and a network interface controller in communication with the memory and servicing remote direct memory access requests from clients. The memory receives a data transfer rate from each client in communication with the memory host through remote direct memory access. Each memory host also includes a data processor in communication with the memory and the network interface controller. The data processor executes a host process that reads each received client data transfer rate, determines a throttle data transfer rate for each client, and writes each throttle data transfer rate to non-transitory memory accessible by the clients through remote direct memory access.

Isolating clients of distributed storage systems

A distributed cache system including a data storage portion, a data control portion, and a cache logic portion in communication with the data storage and data control portions. The data storage portion includes memory hosts, each having non-transitory memory and a network interface controller in communication with the memory for servicing remote direct memory access requests. The data control portion includes a curator in communication with the memory hosts. The curator manages striping of data across the memory hosts. The cache logic portion executes at least one memory access request to implement a cache operation. In response to each memory access request, the curator provides the cache logic portion a file descriptor mapping data stripes and data stripe replications of a file on the memory hosts for remote direct memory access of the file on the memory hosts through the corresponding network interface controllers.

Single-sided distributed cache system

A distributed storage system that includes memory hosts having non-transitory memory storing data chunks of files. Each data chunk is associated with an access control list. Each memory host also includes a network interface controller in communication with the memory for servicing remote direct memory access requests and a computing processor in communication with the memory and the network interface controller. The computing processor executes a host process that registers a set of remote direct memory accessible regions of the memory storing data chunks with the network interface controller. In response to receiving a connection request from a client process of a client to access a data chunk, the host process establishes a remote direct memory access capable connection with the client process when both the client and the data chunk are associated with the same access control list.

Controlling access in a single-sided distributed storage system

A method of managing read/write requests in a non-transitory data storage system includes receiving a read/write request for data stored in the data storage system and processing the read/write request on at least one computing processor. For a read request, the method includes computing a first checksum of the data, comparing the first checksum with a second checksum associated with the data, and allowing a read operation of the read/write request on the data when the first and second checksums match. For a write request, the method includes allowing a write operation of the read/write request on the data, computing a third checksum of the modified data, and associating the third checksum with the modified data.

Detecting read/write conflicts

A method of executing a transaction in a distributed storage system includes, for data chunks of a read set of the transaction, reading data of the data chunks of the read set through remote direct memory access and determining a validity of the read data by evaluating a version and a lock of each data chunk of the read set. For data chunks of a write set of the transaction, the method includes setting locks on the data chunks of the write set, writing data to the locked data chunks through remote direct memory access, releasing the locks of the locked data chunks, and incrementing a version number of each released data chunk.

Growing community of inventors

Madison, WI, United States of America

Kyle Nesbit