Emc IP Holding Company LLC

Dell Products Inc.

Changxu Jiang

Fei Wang

Zhenzong Jiang

Xu Chen

Chen Gong

Hailan Dong

Peilei Chen

Chaojun Zhao

Jianfei Yang

Shuang Zheng

Bo Hu

Xiaoyu Ren

Ling Yan

Embodiments of the present disclosure relate to a method, a device, and a computer program product for processing logs. The method includes determining, based on a duration of a predetermined number of log entries recently recorded by a log recording component, a target log recording component from a group of candidate log recording components. The method further includes determining, based on a predetermined number of log entries recently recorded by the target log recording component, a log group including a plurality of similar log entries. The method further includes determining a duplicate content among the plurality of log entries in the log group and a distinctive content for each of the plurality of log entries. The method further includes updating the plurality of log entries by de-duplicating the duplicate content and retaining the distinctive content for each of the plurality of log entries.

Method, device, and computer program product for processing logs

Techniques for data deduplication compress and deduplicate a first set of blocks written to a source system to obtain a second set of blocks and compression ratios and numbers of duplications for blocks in the second set of blocks. Such techniques receive a request to back up the first set of blocks. Such techniques reconstruct, in response to receiving the request to back up the first set of blocks, the second set of blocks to obtain the first set of blocks. Such techniques mark, based on the compression ratios and the numbers of duplications, blocks in the first set of blocks with deduplication flags to obtain a third set of blocks. Such techniques transmit the third set of blocks to a destination system.

Method, device, and computer program product for data deduplication

Techniques for de-duplicating data involve: determining a target physical block in a first storage device. The techniques further involve: determining a compression ratio of a target data block in a plurality of data blocks to be transferred. The techniques further involve: determining a target hash value of the target data block in response to the compression ratio being lower than a threshold compression ratio. The techniques further involve: determining a de-duplication operation for the target data block based on the target hash value and a de-duplication hash table, the de-duplication hash table storing hash values of data blocks that have been transferred from the first storage device to the second storage device. Accordingly, the amount of data that needs to be transferred can be reduced, and the storage space of the storage devices can be improved, thus increasing the resource utilization and improving the user experience.

Method, device, and computer program product for de-duplicating data

Techniques for transferring data involve: determining a first physical block in a first storage device, the first physical block having a plurality of data blocks stored thereon. The techniques further involve: determining, based on a first data block of the plurality of data blocks, whether a set of logically contiguous data blocks that comprise the first data block exist in the first physical block, the set of data blocks having a target heat greater than a threshold heat. The techniques further involve: transferring, in response to the existence of the set of data blocks in the first physical block, the set of data blocks into a second storage device for contiguous storage in a second physical block of the second storage device. Accordingly, relatively high heat data blocks are transferred to device with higher access speed, thereby reducing data access time, increasing data processing efficiency, and improving user experience.

Method, device and computer program product for transferring data

Techniques involve determining, in response to acquiring a target block size for a shared folder of a first file system in a file system set, a shared folder de-duplication rate. The techniques further involve acquiring a de-duplication block size set supported by a storage system set for the file system set in response to determining that the de-duplication rate is less than a threshold de-duplication rate. The techniques further involve determining whether the de-duplication block size set includes a de-duplication block size that is the same as the target block size. The techniques further involve migrating the shared folder to a second file system in response to the de-duplication block size set including the de-duplication block size that is the same as the target block size. Accordingly, there is improved efficiency in deleting duplicate data, increased amount of deleted duplicate data, saved storage space and improved resource utilization.

Method, device, and computer program product for processing data

An apparatus comprises a processing device configured to maintain a deduplication data structure comprising sub-portions associated with different compression ratio ranges and having different numbers of data block identifiers. The processing device is also configured to identify a given data block identifier and a given compression ratio for a given data block to be stored, and to determine whether the given data block identifier is in a given one of the sub-portions having a given compression ratio range including the given compression ratio. The processing device is further configured, responsive to determining that the given data block identifier is not in the given sub-portion, to write the given data block to a physical space block of the storage system and, responsive to determining that the given data block identifier is in the given sub-portion, to increment a deduplication reference count for the given data block identifier.

Compression ratio-aware data deduplication

Techniques for cache management involve: determining respective elimination scores of a plurality of entries in a cache based at least in part on compression rates of data blocks corresponding to the plurality of entries, the elimination score being proportional to the compression rate; and removing, from the cache, at least one entry with a relatively low elimination score among the plurality of entries. Such techniques are able to optimize the retention and elimination strategies for entries in a cache, thus increasing payoffs for using the cache.

Cache management based on compression rates of data

Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for presenting I/O write records. The method includes: obtaining I/O write records for a file system within a time period; dividing the time period into a plurality of consecutive sub-time-periods based on a predetermined time interval; determining a plurality of I/O write numbers associated with the plurality of sub-time-periods based on the I/O write records; and graphically presenting the plurality of I/O write numbers in chronological order. Using the technical solution of the present disclosure, changes in the I/O write numbers over time can be presented to a user in a chronological, intuitive, and easily recognizable manner, so that the user can easily find a changing law of the I/O write numbers over time, and can further select data protection forms and schedules to be adopted, thereby improving user experience of the user with needs for data analysis and data protection.

Method, electronic device, and program product for presenting I/O write records

Techniques for accessing a file involve determining whether a client requests a permission for a target file, the permission allowing the client to cache data associated with the target file. The techniques further involve in response to determining that the client requests the permission, obtaining pattern information related to an access pattern in which the client accesses the target file. The techniques further involve determining availability of the permission to the client by applying the pattern information to a decision model, the decision model being trained based on training pattern information and training permission information. The techniques further involve providing, to the client, an indication on the availability. Accordingly, access conflicts can be reduced, so that the performance of the client and server can be improved.

Methods, electronic devices, and computer program products for accessing a file

Techniques involve: determining, based on sizes of a storage space used by a file system at a set of historical moments and a current moment, predicted sizes of a storage space to be used by the file system at a plurality of future moments. The techniques further involve: determining sizes of an available storage space and available durations of a set of candidate future moments in the plurality of future moments based on the predicted sizes. The techniques further involve: determining, based on the sizes of the available storage space and the available durations of the set of candidate future moments, predicted values that characterize available storage capacities of the set of candidate future moments. The techniques further involve: determining a target moment from the set of candidate future moments based on the predicted values to recycle at least part of an available storage space of the target moment.

Method, electronic device and computer program product for managing storage space

Techniques process an access management permission. Such techniques involve: receiving, from a client, a first request for obtaining an access management permission of a file. The techniques further involve: obtaining a current score of the file, wherein the current score indicates a probability of receiving, after the access management permission is assigned to the client, a second request conflicting with the first request. The techniques further involve: assigning the access management permission to the client if it is determined that the current score is greater than or equal to a threshold score. Such techniques alleviate the need to assign, to a client, the access management permission of a file with a high probability of an access conflict, thus enhancing the performance of the server as well as the user experience.

Method, device and computer program product for processing access management rights

Techniques for data processing involve: determining, from a disk array, a target disk used for data reconstruction of the disk array; and sending, to an indicating apparatus associated with the target disk, an indication that the target disk is used for the data reconstruction. In this way, such techniques can indicate to the user that the target disk is being used for data reconstruction to remind the user not to remove or move the target disk, thereby ensuring completion of the data reconstruction. Such a technique may improve data storage equipment operation by preventing user interference.

Method, electronic device and computer program product for data processing

A group of state data of storage space in a storage system is collected according to a predetermined time interval, the group of state data being collected at a group of time points, respectively, and the group of time points being divided according to the predetermined time interval. The group of state data is compared with a threshold condition of the storage system, the threshold condition representing that storage space in the storage system is to be exhausted. An association relationship between a state of storage space in the storage system and a future time point is generated based on the group of state data in accordance with determining at least one state data in the group of state data satisfies the threshold condition. A state estimate of storage space in the storage system at a specified future time point is obtained based on the generated association relationship.

Method, device, and program product for managing storage space in storage system

Techniques perform snapshot deletion. Such techniques involve: determining an object associated with a to-be-executed snapshot deletion request in a snapshot deletion request list of a storage system; in response to the object being included in a predefined set of objects, determining information associated with the to-be-executed snapshot deletion request, the information including at least one of: a number of snapshot deletion requests in the snapshot deletion request list which correspond to snapshots associated with the object, and a waiting time of the to-be-executed snapshot deletion request in the snapshot deletion request list; determining, based on the information and from the snapshot deletion request list, a set of snapshot deletion requests associated with the object; and deleting snapshots corresponding to snapshot deletion requests in the set. Accordingly, the performance of snapshot deletion operations may be improved without any impact on other service on the storage system.

Method, device, and computer program product for deleting snapshots

Techniques perform data processing. Such techniques involve: generating, based on a time sequence that a plurality of requests are detected, a first-input first-output (FIFO) queue comprising the plurality of requests sent by a plurality of storage pools in a storage system for reclaiming storage spaces of the plurality of storage pools. Such techniques further involve: determining respective available storage spaces of the plurality of storage pools. Such techniques further involve: updating, based on the available storage spaces, a sequence of the plurality of requests in the FIFO queue for processing. Such techniques can effectively alleviate the problem that the storage pools are short of storage spaces.

Growing community of inventors

Chengdu, China

Changxu Jiang