Shanghai Kyligence Information Technology Co., Ltd

Kuyun (shanghai) Information Technology Co., Ltd.

Qing Han

Lei Zhang

Yifan Zhang

Dong Sheng Li

Hongbin Ma

Lu Cao

Yifei Wu

Zhixiong Chen

Shaoxiong Zhan

The disclosure provides a cloud computing-based adaptive storage layering system and method. The system includes a data node management module, a metadata management module, an adaptive storage layering module, and a pre-aggregated query routing module. According to predefined rules, node capacity is expanded and shrunk, collected queried hit models and scanned file paths are aggregated and sorted, and layering loading and pre-loading are performed on files. Based on the disclosure, an efficient On-Line Analytical Processing (OLAP) query execution engine may be constructed, to deal with complex OLAP queries of various reporting system. Therefore, the execution efficiency of cloud OLAP engines can be significantly enhanced.

Cloud computing-based adaptive storage layering system and method

The present invention discloses a method and a device for processing information by batch-stream fusion, and a storage medium. The method comprises the following steps: Obtaining an index based on an input query statement; extracting a pre-computed index data segment based on the index as a query result; and extracting a re-computed index data segment to update the query result. The present invention solves the technical problem that real-time data and offline data are difficult to fuse and analyze.

Method and device for processing information by batch-stream fusion, and storage medium

The present application discloses a dynamic routing method and apparatus for a query engine in a pre-computing system. The method includes: pre-obtaining cube data under a preset dimensional combination in a pre-computing system; determining a degree of aggregation of the cube data selected as expected under the preset dimensional combination after a query request is received; executing query processing on the query request in a first distributed query engine when the degree of aggregation of the cube data under the preset dimensional combination is high; and switching to a second distributed query engine to execute query processing on the query request when the degree of aggregation of the cube data under the preset dimensional combination is low. The present application solves the technical problem that the query response speed of the pre-computing query system is not ideal. Through the present application, the sub-second high-performance query response can be achieved. At the same time, as a result, higher concurrency can be supported so as to meet business needs, and the stability of the query system is simultaneously guaranteed.

Dynamic routing method and apparatus for query engine in pre-computing system

The present application discloses a data configuration query method and device. The method includes: determining at least two target data sets required to be queried by a query instruction and an ordered association between the target data sets, wherein the ordered association at least includes a unidirectional association and/or a bidirectional association; generating, on the basis of the at least two target data sets and the ordered association between the target data sets, a target association path; and outputting an OLAP model conforming to the target association path in a database. According to the present application, the technical problems of a large demand quantity of OLAP models included in an OLAP query system and a low utilization rate of the OLAP models in the related art can be solved.

Data configuration query method and device

The automatic modeling method and a classifier for OLAP data model includes acquiring a SQL query statement; parsing the SQL query statement and judging whether any syntax error or lexical error exists in the SQL query statement; extracting query structures from the SQL query statement to obtain at least N sets of query patterns, if no syntax error or lexical error exists; classifying the at least N sets of query patterns; merging the query patterns in each class to obtain a corresponding pattern relation tree; and converting the pattern relation tree into a corresponding data model. The classifier includes a static rule classification module, and a statistical rule and preset learning rule classification module. A data model generated with the method and classifier provided in the present invention supports all inputted SQL query statements and has certain generic capabilities to full support Cube operations and quick queries.

Automatic modeling method and classifier for OLAP data model

The present application relates to an OLAP pre-calculation model, an automatic modeling method and an automatic modeling system. The model includes a dimension module, an aggregation group module and a measure module. The method includes collecting data statistics on all data sources to obtain data statistics result, conducting query dryrun based on data model and sample queries given by a user to determine a business model, conducting query dryrun on the sample queries and collecting query statistics, carrying out physical modeling and defining dimension, measure and aggregation group of a pre-calculation model, and obtaining a business modeling result and a pre-calculation model. The system includes data statistics module, business model module, query statistics module, and model establishing modules. A more efficient combination of pre-calculated dimensions can be produced and redundant calculation and data storage can be reduced.

Growing community of inventors

Shanghai, China

Qing Han