Beijing Volcano Engine Technology Co., Ltd.

Zhaowei Huang

Leilei Hu

Kejian Ju

Junling Du

Xuan Luo

Yuanpu Ding

A data reading and writing method, apparatus and electronic device are provided. In one embodiment, the method includes: receiving a data reading and writing request for a first database, wherein the first database stores data in a column-oriented storage format, the data reading and writing request is used for reading/writing data from/into a row storage table, the first database includes a front-end node and a back-end node, the front-end node is used for receiving the data reading and writing request and the back-end node is used for storing data; parsing the data reading and writing request in the front-end node and sending a parsing result to the back-end node; and reading/writing data from/into a second database by using the parsing result in the back-end node, wherein the first database calls data from the second database, and the second database stores data in a row-oriented storage format.

Data reading and writing method, electronic device and medium

A method and an apparatus for executing a data processing task in a cluster mixed deployment scenario and a device are provided. A first electronic device is provided with computing nodes of at least two data engines. A specific implementation of the method includes: in response to a first data engine node receiving a first data processing task, determining a first memory occupancy corresponding to the first data processing task, where the first data engine node is deployed on the first electronic device and belongs to a first data engine; and determining whether to execute the first data processing task based on a second memory occupancy corresponding to another data engine node, where the another data engine node is deployed on the first electronic device and belongs to another data engine other than the first data engine in the at least two data engines.

Method for executing data processing task in cluster mixed deployment scenario, electronic device and storage medium

A data processing method, an electronic device, and a storage medium. The data processing method includes: receiving a data write request; and in response to the target write manner being a first write manner, storing the target data in a key-value storage module by using a key-value storage manner, so that the target data is subsequently read from the key-value storage module, each row of data in the at least one row of data respectively corresponds to one key-value pair, and a data write amount corresponding to the first write manner is less than a first threshold; or, in response to the target write manner being a second write manner, storing the target data in a columnar storage module by using a columnar storage technology, a data write amount corresponding to the second write manner is greater than a data write amount corresponding to the first write manner.

Data processing method and apparatus for columnar storage data warehouse

A data query method based on Doris includes: acquiring history data in a bottom operator in a storage engine architecture of the Doris, and performing an aggregation calculation on the history data to obtain an aggregation result of the history data; caching, by a preset cache system, the aggregation result of the history data; performing an aggregation calculation on real-time data in a newly inserted bottom operator in the Doris, in response to a data query request, to obtain an aggregate result of the real-time data; acquiring the aggregation result of the history data from the preset cache system, and merging the aggregation result of the history data with the aggregation result of the real-time data to obtain merged data; and sending, by a data sending operator in the Doris, the merged data to an upper layer of an execution engine, to output a final data query result.

Growing community of inventors

Beijing, China

Zhaowei Huang