Beijing Volcano Engine Technology Co., Ltd.

New H3c Big Data Technologies Co., Ltd.

Yuanpu Ding

Leilei Hu

Zhaowei Huang

Kejian Ju

Riguang Li

A data processing method, an electronic device, and a storage medium. The data processing method includes: receiving a data write request; and in response to the target write manner being a first write manner, storing the target data in a key-value storage module by using a key-value storage manner, so that the target data is subsequently read from the key-value storage module, each row of data in the at least one row of data respectively corresponds to one key-value pair, and a data write amount corresponding to the first write manner is less than a first threshold; or, in response to the target write manner being a second write manner, storing the target data in a columnar storage module by using a columnar storage technology, a data write amount corresponding to the second write manner is greater than a data write amount corresponding to the first write manner.

Data processing method and apparatus for columnar storage data warehouse

Embodiments of the present disclosure provide a data query method based on on-line analytical processing, an electronic device and a storage medium. The method includes: receiving a first query request, and determining a request type of the first query request; executing a query in a row-based storage portion of an event table of a database in response to the request type being a preset type; and generating a query result based on retrieved target data, wherein the event table includes a column-based storage portion and the row-based storage portion, and the column-based storage portion includes a plurality of data rows; and the row-based storage portion includes a coding column, and each piece of coded information in the coding column includes row data belonging to a same data row in the column-based storage portion.

Data query method based on on-line analytical processing, electronic device and storage medium

A querier sends a SparkSQL query instruction to a connector, the SparkSQL query instruction contains a table identifier of an HBase table, metadata of the HBase table, and an attribute value corresponding to the metadata. When the connector receives the SparkSQL query instruction, if an index table corresponding to the table identifier and the metadata exists in a storage device, the connector generates a first Phoenix query instruction and sends the first Phoenix query instruction to the storage device, the index table is used to record a correspondence between an attribute value of the metadata of the HBase table and a RowKey of the HBase table, and the first Phoenix query instruction contains the table identifier, the metadata, and the attribute value. When receiving the first Phoenix query instruction, the storage device obtains the RowKey and the metadata, obtains the data row, and sends the data row to the connector.

Growing community of inventors

Beijing, China

Yuanpu Ding