Google Inc.

Alex Kesselman

Alexandre Drobychev

A system, computer-readable storage medium storing at least one program, and a computer-implemented method for facilitating deduplication of operations to be performed is presented. An operation to be performed is received. A mapping function is applied to at least one parameter of the operation to produce a mapping value in a target mapping space, the target mapping space being partitioned between target servers in a set of target servers proportional to resource capacities of the target servers in the set of target servers. A target server in the set of target servers whose portion of the target mapping space includes the mapping value is identified. The operation is issued to the target server.

Systems and methods for facilitating deduplication of operations to be performed

System and method for facilitating deduplication of operations to be performed

A process manages database storage. The process receives a first object comprising one or more content chunks. The first object is identified by a unique object ID and each content chunk has a unique offset within the first object. For each chunk, the process inserts a record into a reference table. The record includes a content hash and the object ID. The process stores each of the chunks in content storage. Later, the process obtains a request to delete a first chunk from storage. The first chunk has a corresponding first content hash. The process determines whether the reference table includes a reference record corresponding to the first content hash. When the reference table does not include any reference records corresponding to the first content hash, the process deletes the first chunk. When the reference table includes a corresponding reference record, the process does not delete the first chunk.

Efficient reference counting in content addressable storage

According to some implementations, a method of managing database storage is performed for a database storage system having content storage, a content index, and a reference table. The content index identifies content chunks and the reference table stores references to each content chunk. An object is received for storage, which comprises one or more content chunks. The object is identified by a unique object ID. For each content chunk, the method constructs a content hash of the content chunk and looks up the content hash in the content index. When the content hash is not found in the content index, the method stores the content chunk in the content storage and inserts a record into the content index that identifies the location of the content chunk in the content storage. In addition, the method inserts a record into the reference table, which includes the content hash and the object ID.

A system, computer-readable storage medium storing at least one program, and a computer-implemented method for dynamically allocating memory for processes is presented. A first request to allocate memory for a first process is received, where the first process is associated with a first quality-of-service class in a plurality of quality-of-service classes. A first memory allocation for the first quality-of-service class is calculated as a function of a current amount of free memory on the server and a first minimum memory allocation for the first quality-of-service class. An amount of memory currently used by processes associated with the first quality-of-service class is determined. The first request is rejected when the amount of memory currently used by the processes associated with the first quality-of-service class is greater than or equal to the first memory allocation.

Growing community of inventors

Sunnyvale, CA, United States of America

Alex Kesselman