Western Digital Technologies, Inc.

Sandisk Technologies Inc.

Quantaro, LLC

Vladislav Bolkhovitin

Brian Walter O'Krafka

Sanjay Subbarao

Anand Kulkarni

Siva Munnangi

Adam Roberts

Warren Fritz Kruger

Nisha D Talagala

Stephen Gold

Robert A Wipfel

Swaminathan Sundararaman

Sriram Subramanian

Johann George

Manavalan Krishnan

Kirill Malkin

Vivek Shivhare

Evgeniy Firsov

Brian W O'KRAFKA

An ultraconverged architecture has multiple availability zones within a single server. The functionality in each of the availability zones is independently controlled, such that resetting and/or disconnecting any component in any availability zone from power and replacing said component does not affect availability of any other component in any other availability zone. A manager of availability zones controls reset functionality in each of a plurality of availability zones. The manager of availability zones generates a requested reset type in the requested availability zone. The manager of availability zones generates reset signals or requests for some or all components located in multiple availability zones. The reset signal or request is generated upon external request to the manager of availability zones that specifies the reset type, the availability zone, and optionally the list of components to be reset. The manager of availability zones discovers and enumerates the components in each availability zone.

Ultraconverged systems having multiple availability zones

Example multi-device storage systems, storage devices, and methods provide hosted services on peer storage devices. Storage devices include a storage medium, a logical mapping memory, and a processor for executing hosted services using the logical mapping memory. Each storage device is configured to communicate with peer storage devices over an interconnect fabric. The logical mapping memory includes storage device media logical mapping information configured in continuous logical blocks with a media block size equal to a page programming size of the storage medium. The logical mapping memory also includes host logical mapping information, configured in host logical blocks with a host block size smaller than the media block size, for the peer storage devices.

Multi-device storage system with hosted services on peer storage devices

Systems and methods for offloading data processing tasks using in-storage code execution are disclosed. For example, a data storage system including one or more processors, a non-transitory storage medium, and a storage logic executable by the one or more processors to perform operations including: receiving portable code configured to perform a data processing offload task, the portable code comprising one or more translatable, hardware-agnostic instructions for processing data stored on the storage medium; translating and executing the one or more translatable, hardware-agnostic instructions of the portable code to perform the data processing offload task using a translation and execution engine disposed in the storage logic; determining that use of the portable code has concluded; and responsive to determining that use of the portable code has concluded, releasing the portable code.

Data processing offload using in-storage code execution

A system and method improve the performance of non-volatile memory storage by rebuilding, on the fly, 'lost data' in response to a read request, which identifies data to be read or recovered, by identifying a parity data storage device in a set of data storage devices that contains parity corresponding to the identified data; sending a reconstruction request to a respective data storage device, which may be the parity data storage device or other data storage device in the system, to reconstruct the identified data, and receiving the identified data from the respective data storage device. The reconstruction request commands the respective data storage device to retrieve, via peer-to-peer read requests, from other data storage devices, data from one or more data blocks, and to reconstruct the identified data based on the retrieved data and parity data locally stored at the parity data storage device.

Data storage drive rebuild with parity generation offload using peer-to-peer data transfers

Methods and systems for rebuilding a failed storage device in a data storage system. For example, a method including identifying a first garbage collection group (GCG) in a storage array for garbage collection; extracting valid data and redundancy information from functioning storage devices in the storage array associated with the first GCG; reconstructing data of a failed storage device associated with the first GCG based on the extracted valid data and redundancy information from the functioning storage devices associated with the first GCG; consolidating the extracted valid data from the functioning storage devices and the reconstructed data of the failed storage device associated with the first GCG; writing the consolidated extracted valid data from the functioning storage devices and the reconstructed data of the failed storage device associated with the first GCG to a second GCG in the storage array; and reclaiming the first GCG identified for garbage collection.

Failed storage device rebuild method

A system and method improve the performance of non-volatile memory storage by automatically, when one or more data storage devices are added to a first set of storage devices in a storage system, resulting in a second set of storage devices, remapping data stored in the first set of storage devices so as to redistribute data across the second set of storage devices while minimizing the amount of data moved to the newly added storage devices. In addition, the remapping and redistribution of data results in empty logical address regions in data storage devices from which data is copied, and a logical address compaction operation is used to remap one or more logical address ranges so as to eliminate the empty logical address regions, without moving data corresponding to the remapped logical address ranges.

Data storage system scale-out with local address remapping

Example storage systems, storage devices, and methods provide secure transfer of data between peer storage devices using protection information. Data operation commands may be received that use a protection information data block format for transferring a target data block between peer storage devices. A local data operation may operate on the target data block in a first storage device and compare at least one protection information tag value to a first data check value. At least one destination verification protection information tag value and the target data block may be transferred to a second storage device through a peer communication channel. The destination verification protection information tag value may be compared to a destination data block protection information tag value by the second storage device. The second storage device may then execute a data operation on the target data block. Protection information tag values may include guard tag values, reference tag values, and application tag values managed by the peer storage devices.

Peer storage devices supporting protection information

Methods and systems for rebuilding a failed storage device in a storage system using a plurality of dynamically selected locations in a system-level overprovisioned (OP) space. For example, a method including designating a portion of a usable space in a storage system as a system-level OP space; in response to a detection of a failed storage device in the storage system, reconstructing data of the failed storage device based on data read from a plurality of functioning storage devices in the storage system; and storing the reconstructed data of the failed storage device in a plurality of dynamically selected locations in the system-level OP space of the plurality of functioning storage devices.

Failed storage device rebuild using dynamically selected locations in overprovisioned space

Data management functions are offloaded from a main controller to individual storage devices in a multi-device storage environment. The main controller receives a data management request from a host system, and responds by determining one or more storage devices and one or more data management operations to be performed by the one or more storage devices. The main controller initiates performance of a data management function corresponding to the data management request, by sending one or more data management commands to the one or more storage devices, and initiating one or more data transfers, such as a direct memory access operation to transfer data between a memory buffer of a storage device and a host memory buffer of the host system, and an internal data transfer between two or more of the storage devices using an internal communication fabric of the data storage subsystem.

Offloaded disaggregated storage architecture

Methods, systems, and other aspects for reconstructing data and rebuilding a failed storage device in a storage system using one or more functioning compute resources and/or storage resources of the failed storage device. For example, a method may include, responsive to a detection of a failed storage device in a storage system, locating data and redundancy information in functioning storage device(s) in the storage system for reconstructing data of the failed storage device; issuing peer-to-peer commands to the functioning storage device(s) to obtain the data and the redundancy information from the functioning storage device(s); and reconstructing the data of the failed storage device based on the data and the redundancy information obtained from the functioning storage device(s), wherein a functioning compute resource of the failed computing device at least partially performs one or more of the locating, issuing, and reconstructing.

Rebuild assist using failed storage device

Methods, systems, and other aspects for using a failed storage device in a peer-to-peer (P2P) storage system to perform a storage-centric task. For example, a method may include, responsive to a detection of a failed storage device in a P2P storage system, determining, by the failed storage device, that a storage-centric task is assigned to the failed storage device; and performing, by the failed storage device, the storage-centric task responsive to P2P communications with a functioning storage device in the P2P storage system.

Using failed storage device in peer-to-peer storage system to perform storage-centric task

A system and method improve the performance of non-volatile memory storage by facilitating direct memory access (DMA) transfers between a remote host and a non-volatile memory based storage system, such as a flash memory based data storage device (e.g., a solid state drive (SSD)). In conjunction with reading from and writing to non-volatile memory storage, a memory buffer on the non-volatile memory system is allocated, and a read or write command is translated to point to the allocated buffer. Thereafter, read and write operations may be performed through a controller, such as a non volatile memory express (NVMe) controller, using remote direct memory access (RDMA) transfers, thus bypassing time consuming processor steps of buffering data to main memory and allowing bi-directional throughput to reach network and SSD speeds.

Non-volatile memory over fabric controller with memory bypass

Example multi-device storage systems, storage devices, and methods provide hosted services on peer storage devices. Storage devices include local memory resources, such as operating memory, remotely addressable memory, or logical mapping memory, and compute resources, such as a processor or coding engine. Each storage device is configured to communicate with a plurality of peer storage devices over an interconnect fabric. The storage devices identify requested hosted services from service host requests received through the interconnect fabric. The storage devices store a plurality of hosted services are to enable access to local memory resources and local compute resources for data management operations for the plurality of peer storage devices.

Growing community of inventors

San Jose, CA, United States of America

Vladislav Bolkhovitin