Hangzhou Hikvision Digital Technology Co., Ltd.

Hangzhou Hikvision System Technology Co., Ltd.

Hangzhou Hikivision System Technology Co., Ltd.

Qiqian Lin

Weichun Wang

Wei Wang

Peng Lin

Min Ye

Weiqiang Xia

Shiliang Pu

Wei Chen

Guangkai Ding

Fanli Zeng

Ping Jin

Li Cao

Yingxue Long

Huadong Huang

Zhiyong Ding

Shengsen Zhang

Shengpeng Jin

Yinmei Xiong

Bo Zhou

Chun Yan

The present application provides a data storage method, a data storage apparatus and a storage system, wherein the method includes: determining a data type of to-be-stored data when the to-be-stored data is obtained (S); determining a target storage area with a data type same as that of the to-be-stored data based on the data type of data stored in each storage area in the SMR disk (S); determining in the target storage area a target storage block into which the to-be-stored data is to be written (S); generating the main index information and backup index information of the to-be-stored data based on the identifier of the target storage block (S); generating the database index information of the to-be-stored data based on the to-be-stored data and the identifier of the target storage block (S); and writing the to-be-stored data and the backup index information of the to-be-stored data into the target storage block, writing the main index information of the to-be-stored data into the CMR area or the non-SMR disk, and writing the database index information of the to-be-stored data into the non-SMR.

Index storage in shingled magnetic recording (SMR) storage system with non-shingled region

Disclosed is a data reconstruction method and apparatus, and an electronic device, and a storage medium. The method comprises: obtaining attribute information for a plurality of to-be-reconstructed data items; wherein the attribute information of any of the to-be-reconstructed data items is information recorded before the to-be-reconstructed data item is lost; determining, according to the attribute information for the plurality of to-be-reconstructed data items, a reconstruction order for the plurality of to-be-reconstructed data items in a preset target sorting manner; wherein, the target sorting manner relates to the attribute information, and in the target sorting manner, a data item of greater importance has a higher priority in reconstruction. Recovery rate of important data is increased.

Data reconstruction method, apparatus, electronic device, and storage medium

A data writing and reading method and apparatus, and a cloud storage system. The data writing method includes an access node receiving a data write request, identifying domain identification information contained in the data write request when failing to obtain an available management node, and querying a pre-saved index according to the domain identification information, wherein the index includes a correspondence between a resource pool and domain identification information, identifying a target resource pool that matches the domain identification information, each resource pool including at least one storage server, determining, from at least one storage server included in the target resource pool, one of the storage servers as a target storage server, and writing data to be written into the target storage server, to ensure that the cloud storage system operates normally without additional cost when all management nodes are at fault or the management node cluster network is abnormal.

Data writing and reading method and apparatus, and cloud storage system

A data processing method and device, and a distributed storage system are described. The method and device are applied in a dual-control storage server. The dual-control storage server comprises two controllers. If one controller fails due to abnormalities, the other controller determines the storage device managed by the failed controller, and the other controller scans the data in the determined storage device to obtain the metadata of the storage device, and uses the metadata to read the data stored in the determined storage device. It can be seen that in this solution, if one controller is abnormal, the other controller will take the place of the failed controller to provide external services. This improves the stability of the data storage by the dual-control storage server.

Data processing method, device and distributed storage system

Disclosed are a storage system, and a method and an apparatus for allocating storage resources. In the storage system, a target management node allocates a target storage node to a monitoring device according to a first storage request; the target storage node allocates a target storage volume to the monitoring device according to a second storage request, allocates a target block group from the target storage volume to the monitoring device, acquires monitoring data in the form of a data stream from the monitoring device, and stores the monitoring data in the target block group. The storage system may select a management node from a management cluster to allocate a storage node to a monitoring device, and the storage node may allocate a storage position to the monitoring device. The storage position that is allocated to monitoring data can be determined by the management node and the storage node hierarchically.

Storage system, and method and apparatus for allocating storage resources

The present disclosure relates to a method and apparatus for storing data, and belongs to the technical field of storage. The method includes: receiving a storage request carrying target data, wherein the target data includes at least one data stripe, each data stripe including a plurality of data blocks; determining, among a plurality of preset storage device groupings, a target storage device grouping for storing the target data; and storing, for each data stripe, the plurality of data blocks in the data stripe into different storage devices in the target storage device grouping respectively. The risk of data loss may be reduced by employing the present disclosure.

Method and apparatus for storing data

The embodiments of the present application disclose a data processing method and system based on cloud storage. The method includes: a cloud management device receiving a data query request sent by a client via a cloud work device, wherein the data query request is used to request for querying media data that has been stored in a cloud domain, the cloud work device is a default storage cloud domain of an IP camera; the cloud management device querying whether the media data collected by the IP camera is stored in a cloud backup device according to the data query request; and if the cloud management device determines that the media data of the IP camera is stored in the cloud backup device according to the data query request, pushing an address of the media data to the cloud work device, wherein the address of the media data is used for the client to request for querying the media data from the cloud backup device. The present application solves the technical problem of poor data storage flexibility among cloud domains in related arts.

Cloud storage based data processing method and system

Embodiments of the present application provide a method for storing video data in the cloud storage system, which includes: receiving to-be-stored video data; obtaining identification information of a storage object corresponding to the to-be-stored video data; determining the storage object corresponding to the to-be-stored video data, and a first data security level and a second data security level corresponding to the storage object based on the identification information; wherein, the first data security level is higher than the second data security level; for each frame in the to-be-stored video data, determining whether the frame is a key frame; and storing the frame into the determined storage object based on the first data security level when the frame is the key frame and storing the frame into the determined storage object based on the second data security level when the frame is not the key frame. With the method for storing video data, the key frame in the video data is protected and the risk of losing video data is reduced.

Video data storage method and device in cloud storage system

A method and device for improving data storage security, related to the technical field of cloud storage is disclosed. The method includes: detecting access counts of user data sets in a cloud storage resource pool, where the user data sets in the cloud storage resource pool are data obtained by encoding with an erasure coding algorithm of a first security level; determining a first user data set whose access count in the cloud storage resource pool meets a preset condition; obtaining a second security level according to attribute information of the cloud storage resource pool, wherein the attribute information includes the first security level and an increment for security step; and re-encoding the first user data set with an erasure coding algorithm of the second security level to obtain re-encoded first user data sets.

Method and device for improving data storage security

The present disclosure provides a data storage method, belonging to the field of data processing. The method is applied to a storage server in a cloud storage system. The method includes: monitoring data transmission status of a data acquisition device; obtaining data exception information according to the monitored data transmission exceptional status; transmitting a first data backhaul request to the data acquisition device, the data acquisition device being configured to return first data acquired within the exception time period upon receiving the first data backhaul request; and storing the first data upon receiving the first data.

Data storage method, storage server, and storage medium and system

A method and an apparatus for updating data for a distributed database system are disclosed. The method includes: obtaining a data table stored in each of servers in the distributed database system, and for each obtained data table, reading each row of data in this obtained data table (S); determining, for each row of data read, whether a key for this row of data exists in the hash table stored in the server (S); if the key for this row of data does not exist in the hash table, writing the row of data into the hash table, and writing the key and version information for the row of data into the hash table (S); if the key for this row of data exists in the hash table, reading a first version number of the row of data in the data table, and determining whether the first version number is greater than a second version number for the row of data stored in the hash table (S); if the first version number is greater than the second version number, updating the row of data into the hash table and updating version information for the row of data (S); sending the hash table to a master server so as to cause each of servers in the distributed database system to perform data recovery based on the hash table received by the master server (S). The method can recover the latest data in a distributed database system.

Data updating method and device for a distributed database system

The embodiments of the present disclosure disclose a method and apparatus for reading or writing disk data. The disk includes a primary metadata block storing metadata, a backup metadata block for backing up metadata, and at least one object block group. Each object block group includes a data block storing object data, and an index block storing an index of the object data. The primary metadata block is located at a head of the disk; and the backup metadata block is located at a tail of the disk. The at least one object block group is located between the primary metadata block and the backup metadata block. In reading or writing object data, the index in the index block, the metadata in the primary metadata block and the metadata backed up in the backup metadata block can be separately operated. By applying the embodiments of the present disclosure, the life and security of the disk are increased.

Disk data reading/writing method and device

Embodiments of the present application provide a method and apparatus for displaying objects. In the method, data segments of to-be-stored data are stored in storage objects. A storage object is a minimum unit for data storage. The difference between the number of data segments stored in a storage object and that of another storage object is no more than a first preset threshold. Data segments are equally stored, to the greatest extent, into storage objects. The case that data having segments lost due to failure of a storage object cannot be restored is avoided.

Data storage, distribution, reconstruction and recovery methods and devices, and data processing system

Disclosed are data storage, data reading, and data cleaning methods and devices, and a cloud storage system. Storage blocks of storage nodes are grouped into resource pools. A method can include: for each resource pool, determining a first number of occupied storage blocks in the resource pool (S); determining whether the first number meets a preset data cleaning condition (S); if so, sending a data cleaning instruction to a storage node where each occupied second storage block in the resource pool is located, such that the storage node cleans the data stored on the second storage block in the storage node (S). That is to say, the management node determines the number of occupied storage blocks of a resource pool. When the number meets a preset data cleaning condition, the data in the storage block is cleaned. Such a process is simple, reducing the workload of management node.

Data storage, reading, and cleansing method and device, and cloud storage system

The hard disk management system includes at least one object server and a managing server. The object server is configured for sending a first request to a managing server to obtain object hard disk information. The managing server is configured for obtaining object hard disk information corresponding to the object server after receiving the first request, and sending the object hard disk information to the object server. The object server is further configured for monitoring and managing a group of object hard disks indicated by the object hard disk information.

Growing community of inventors

Hangzhou, China

Qiqian Lin