Emc IP Holding Company LLC

Pengfei Su

Julius Jian Zhu

Lingling Yao

Lu Lei

Jingjing Liu

Indices of storage systems are managed. An example method includes: receiving a flush cycle for flushing expired events in a storage system including multiple events in a data stream, determining, based on the flush cycle, a time slice for managing the index of the storage system, creating a slice index node for the time slice in response to determining that the occurrence time of a first event that enters the storage system in the data stream is within the time slice, wherein the slice index node includes an index node of the first event, and adding the slice index node to the index. A corresponding device and a corresponding computer program product are provided. Thus, the index of a large number of events entering the storage system is managed according to the occurrence time of the events, and the storage system can be searched and updated accurately and effectively.

Method, device, and program product for managing index of storage system

An active layer of the index includes a first shard group, and shards in the first shard group are configured to store indexes of a part of data objects in a streaming storage system. In response to determining that the state of the first shard group meets a predetermined expansion condition, a second shard group is created in the index, and shards in the second shard group are configured to store indexes of data objects that will enter the storage system. The storage system is managed based on the shards in an active layer (where the second shard group is located) and frozen layers (where the second shard group) in the index. The number of shards in the storage system can be dynamically set to process streaming data at a relatively high speed, and it is suitable for processing streaming data that continuously enters the storage system.

Method, device, and program product for managing index of streaming data storage system

Embodiments of the present disclosure relate to processing data. An example method includes acquiring data related to a first moment in streaming data of an object to be processed. The method further includes storing the data in a first entry of a data table based on an identification of the object to be processed, wherein the data table further includes a second entry before the first entry, and the second entry stores data related to a second moment before the first moment in the streaming data. The method further includes updating an index related to the object to be processed based on the first entry. Thus, a solution to the problem of performing search in data at different moments is provided, and it is unnecessary for a user to participate in the solution, thus improving the user experience and reducing the use of storage resources.

Method, electronic device, and computer program product for processing data

An index of a storage system is managed. For example, events in a data stream to be stored are received. According to a predetermined length of a time window and occurrence times of the events, an event among the events that occurs within the time window is determined. Based on the event, a window index node is created including an index of the event. In response to determining that a current time point meets a threshold time point corresponding to the time window, the window index node is added to the index, and the threshold time point indicates that the number of received events that occur within the time window in the data stream reaches a threshold number. Thus, an index can be created in time for a large number of events entering the storage system. Further, the storage system can be queried and updated accurately and effectively.

Growing community of inventors

Shanghai, China

Pengfei Su