Alibaba Group Holding Limited

Weixun Wu

Jianghua Li

Jinyin Zhang

Ang Li

Song Chen

The present invention discloses a method and a system for log file analysis based on distributed computing network. The method includes: storing user identifiers and related log information into a log file; dividing the log file into target files each including the log information having the same user identifier; separately analyzing the target files to obtain analysis results using at least two nodes; and combining the analysis results of the nodes. The method thereby establishes relationships among various log files through user identifiers, and further analyzes the relationships among the user's accesses to various contents of a website.

Method and system for log file analysis based on distributed computing network

A data merging method for distributed computing uses a configuration file to guide the insertion of computational results obtained by distributed nodes into a database table, and to merge the computational results inserted in the database table. The configuration file is established according to the task splitting conditions of distributed computing. The method uses a data merging server to import and host the configuration file and create a database table corresponding to the configuration file. Each distributed node inserting its distributed computational result into the database table after completing the respective distributed computing task, while the data merging server merges the data in the database table. An interface standard applicable to various uses and various distributed computing tasks may be used such that the user only needs to establish a job-specific configuration file based on the interface standard.

Growing community of inventors

Zhejiang, China

Weixun Wu