Western Digital Technologies, Inc.

Souvik Roy

Tomy Ammuthan Cheru

Ameet Pyati

Carl Rene D'Halluin

Muhammad Tanweer Alam

Sazid Mahammad

Priya Lekkala Vishnu

Example distributed object storage systems and methods provide secure object replication. Data objects are encrypted for reading and decrypted for writing to prevent unwanted data access by a replication user credential that does not need access to the user data. During an object storage operation for reading and writing an identified data object, read operations are encrypted to create an encrypted data object corresponding to the identified data object. The encrypted data object may be moved between a first storage node and a second storage node. The encrypted data object is decrypted during write operations to write the identified data object to the second storage node. A user credential in the object storage operation may identify a replication user credential for selectively encrypting and decrypting the identified data object.

Object storage system with secure object replication

An example system includes an enclosure having a plurality of small computer system interface (SCSI) drives partitioned into a first zone including a first SCSI drive of the plurality of SCSI drives and a second zone including a second SCSI drive of the plurality of SCSI drives. The system includes a plurality of communication ports having a first port through which the first zone communicates; and a second port through which the second zone communicates. The system includes a management node configured to interact with the first SCSI drive in a first server as a first Internet SCSI (iSCSI) drive, and with the second SCSI drive in a second server as a second iSCSI drive.

Management of zoned storage drives

Example object storage systems, bookkeeping engines, and methods provide quota-based access control for control entities, such as accounts, users, and buckets. An object data store is configured to enable control entities to access data objects associated with each control entity. Quota thresholds and usage values are determined for control entities and used to determine a quota status. Quota status is used to determine data object access response based on the requesting control entities.

Object storage system with access control quota status check

The described methods, systems, and other aspects can advantageously provide balanced multi-stage processing of non-uniform object data. An example method may receive a list of buckets. Each of the buckets in the list of buckets can store one or more restorable objects. The method further comprises distributing the list of buckets to the two or more second nodes; determining a number of the one or more restorable objects in each bucket; determining a size of the one or more restorable objects in each bucket; generating batches of to-be-restored data objects based on the determined number of the one or more restorable objects in each bucket and the determined size of the one or more restorable objects in each bucket; and distributing the batches among the two or more second nodes for storage-related task processing.

Distributed batch processing of non-uniform data objects

These methods, systems, and other aspects can provide for adaptive distribution/re-distribution of data processing tasks. An example method may create, by a processor in a first node, a status object for a data processing task and assign, by the processor in the first node, the data processing task to a worker of a second node. Further, after a first period of time, the method may query, by the processor in the first node, the status object for a task status of the assigned data processing task reported by the second node. The task status reflects a status of execution of the assigned data processing task by the second node. The method determines, by the processor in the first node, to reassign the assigned data processing task based on a received task status reported by the second node, and reassign, by the processor in the first node, the assigned task.

Adaptive work distribution in distributed systems

Example distributed object storage systems and methods provide ordered parallel replication of data object parts. Batch lists of data objects that identify data parts for replication are generated. Available replication engines are identified and the data parts are sorted according to a predetermined order, such as largest to smallest by part size, to create an ordered list. The data parts are then sequentially assigned to the available replication engines based on the ordered list of data parts for parallel processing of replication commands. Initiate-multipart commands may be executed before the data parts are processed and complete-multipart commands may be executed after the data parts are processed.

Growing community of inventors

Bengaluru, India

Souvik Roy