Amazon Technologies, Inc.

Munif M Farhan

Seth William Markle

Darin Lee Frink

Keun Soo Jo

Nafea Bshara

Douglas Stewart Laurence

Andrew Kent Warfield

Jaime Ismael Rangel Martinez

Thomas Grant Slatton

Phyllis Ng

Roey Rivnay

Ahmed Mohammed Shihab

Andrew Christopher Schleit

James Alexander Bornholt

Luis Padilla Munoz

Troy Cognata

Technologies are provided for dynamically changing a size of a cache region of a storage device. A storage device controller writes data to the cache region of the storage device using a particular storage format. The storage device controller then migrates the cached data to a storage region of the device, where the data is written using a different storage format. A dynamic cache manager monitors input and output activity for the storage device and dynamically adjusts a size of the cache region to adapt to changes in the input and/or output activity. The dynamic cache manager can also adjust a size of the storage region. The storage device controller can automatically detect that the storage device has dynamic cache support and configure the storage device by creating the cache region and the storage region on the device.

Dynamic cache management in hard drives

Technologies are provided for supporting multi-actuator storage device access using logical addresses. Separate sets of storage locations on a storage medium of a storage device can be associated with different actuators of the storage device. For example, a first set of storage locations can be assigned to a first actuator of the storage device and a second set of storage locations can be assigned to a second actuator of the storage device. The storage locations of the storage medium can be associated with logical addresses. The storage device can receive a data access request containing a logical address and can identify a storage location associated with the logical address. The storage device can identify a storage location set to which the storage location belongs and can use an actuator associated with the storage location set to access the storage location associated with the logical address.

Hard disk access using multiple actuators

Technologies are provided for supporting multi-actuator storage device access using logical addresses. Separate sets of logical addresses (such as logical block addresses) can be associated with different actuators of a storage device. For example, a first set of logical addresses can be assigned to storage locations on one or more storage media that is/are accessible using a first actuator of the storage device and a second set of logical addresses can be assigned to storage locations on one or more storage media that is/are accessible using a second actuator of the storage device. The storage device can receive a data access request containing a logical address and can identify a logical address set to which the logical address belongs. The storage device can use an actuator associated with the logical address set to access a storage location assigned to the logical address.

Multi-actuator storage device access using logical addresses

Technologies are provided for supporting storage device write barriers. A host computer can be configured to transmit a write barrier command to a storage device to indicate that one or more data access commands should be processed before one or more other data access commands are processed. For example, a host computer can transmit one or more data access commands to a storage device. The host computer can then transmit a write barrier command to the storage device. The storage device can be configured to receive the write barrier command and to associate a write barrier with the one or more data access commands. The host computer can continue to transmit additional data access commands to the storage device. However, the storage device will not process the additional data access commands until after the one or more data access commands associated with the write barrier have been processed.

Storage device write barriers

Technologies are provided for storing data in a storage device based on an associated attribute or attributes. A storage device can be configured to write data to a storage location of the storage device based on an associated attribute. The attribute can describe one or more storage-related requirements of the data. The storage device can identify one or more storage locations where the data can be stored that meet the storage-related requirements described by the attribute. A host computer can transmit an updated attribute for the data to the storage device to reflect new storage-related requirements for the data. The storage device can write the data to a new storage location that meets the new requirements. A mapping table can be maintained that associates a logical identifier for the data with the actual storage location where the data is stored.

Attribute-driven storage for storage devices

Technologies are provided for a storage device data move command. A storage device can be configured to receive a data move (or garbage collection) command and, responsive to receiving the command, move data from one zone of the storage device (or range of storage locations within the storage device) to another zone (or another range of storage locations) within the storage device. The command can comprise a source zone identifier and a target zone identifier. The storage device can read data from a storage zone associated with the source zone identifier and write the data to another storage zone associated with the target zone identifier. The identifiers can include ranges of storage location addresses within the separate storage zones. In at least some embodiments, a host bus adapter can be configured to support the data move (or garbage collection) command for a storage device attached to the host bus adapter.

Efficient storage device data move operation based on priority of garbage collection command

Technologies are provided for supporting storage device write barriers. A storage device can be configured to associate a data access command with a write barrier. The write barrier can be used to indicate that one or more data access commands should be processed before one or more other data access commands are processed. For example, a host computer can transmit one or more data access commands to a storage device. The storage device can determine that the one or more data access commands are associated with a write barrier. The host computer can continue to transmit additional data access commands to the storage device. However, the storage device will not process the additional data access commands until after the one or more data access commands associated with the write barrier have been processed.

Technologies are provided for storing data by alternating the performance of data write operations using multiple clusters of storage devices. Data is written to internal buffers of storage devices in one cluster while data stored in buffers of storage devices in another cluster is transferred to the storage devices' permanent storages. When available buffer capacity in a cluster falls below a specified threshold, data write commands are no longer sent the cluster and the storage devices in the cluster transfer data stored in their buffers to their permanent storages. While the data is being transferred, data write commands are transmitted to other clusters. When the data transfer is complete, the storage devices in the cluster can be scheduled to receive data write commands again. A cluster can be selected for performing a given data write request by matching the attributes of the cluster to parameters of the data write request.

Cluster based hard drive SMR optimization

Technologies are provided for accessing a physical location of a storage medium reader of a storage device. A computing device can transmit a request for the storage medium reader's physical location. The storage device can determine the physical location of the storage medium reader and transmit the location to the computing device. The computing device can use the physical location of the storage medium reader to determine an expected latency for retrieving one or more stored data items. The computing device can transmit a command to change the physical location of the storage medium reader, for example by changing a location of the storage medium reader with respect to a given storage medium and/or changing a storage medium that is accessed by the storage medium reader. The computing device can control the placement of the storage medium reader in order to optimize retrieval of data items from the storage device.

Storage medium reader physical location access

A multi-actuator storage device includes separate actuators that can be used to access a storage medium. A property of a request can be analyzed to determine which actuator to use to access data associated with the request. For example, high-priority requests can be handled by an actuator designated for random I/O requests, whereas low-priority requests can be handled by an actuator designated for sequential I/O requests. Writes can be treated as low-priority requests. In a particular embodiment, a priority bit can be used to determine which actuator is used to access the data.

Multi-actuator storage device with actuator selection

Technologies are provided for secure sanitization of a storage device. A storage device can be configured to support an operational mode, into which the storage device is placed by default, and in which requests to cryptographically erase the storage device are rejected. The storage device can support a separate sanitization mode in which a request to cryptographically erase the storage device will be processed. Access to the sanitization mode can be restricted to trusted sources (such as a boot firmware of a computer connected to the storage device). The storage device can be configured to reject a command to place the storage device in the sanitization mode, unless the command is received during an initialization of the storage device. In at least some embodiments, the storage device can reject data access commands while it is in the sanitization mode.

Storage data sanitization

Dynamic cache management in storage devices

Technologies are provided for retrieving service level indicators (SLIs) for storage devices, prioritizing data access using the SLIs, and scheduling storage device maintenance based on the SLIs. A host computer can retrieve an SLI for a storage device and determine, using the SLI, whether the storage device is performing service and maintenance operations and/or whether the storage device is in need of performing service and maintenance operations. The host computer can retrieve SLIs for multiple storage devices storing data redundantly and prioritize using the storage devices to access the data based on the SLIs. If the host computer determines that a storage device is in need of maintenance, based on its SLI, the host computer can schedule the storage device for maintenance and divert data access requests to other storage devices until the maintenance is complete.

Host-accessible storage device service level indicators

Technologies are provided for partially updating shingled magnetic recording (SMR) zones in SMR storage devices. An SMR storage device can receive and process a command to update a write pointer for an SMR zone to point to an arbitrary write position within the SMR zone. A partial SMR zone update command can be received and processed to modify part of the data stored in the SMR zone. A write position within the SMR zone where data to be modified is stored can be identified. Data stored in the SMR zone following the identified write position can be read to a temporary location and modified. A write pointer for the SMR zone can be updated to point to the identified write position. The modified data can then be written to the SMR zone, starting at the write position identified by the write pointer, or to another SMR zone of the storage device.

Partial updates for shingled magnetic recording devices

Technologies are provided for a dynamically scalable storage architecture. A workload manager can be configured to monitor compute workloads targeting network-enabled storage devices. The workload manager can identify servers to perform all or part of the compute workloads. The workload management server can configure the identified servers to establish logical connections with the network-enabled storage devices, wherein the identified servers can transmit data access commands to the network-enabled storage devices via a computer network. The identified servers can then be used to perform all or part of the compute workloads targeting the network-enabled storage devices. In at least some embodiments, the workload manager can monitor a pool of available servers, from which servers can be identified and associated with network-enabled storage devices. In a different or further embodiment, the workload management server can instantiate new virtual servers and associate the virtual servers with network-enabled storage devices.

Growing community of inventors

Clyde Hill, WA, United States of America

Munif M Farhan