Huawei Technologies Co., Limited

Songshan Zhang

Mingzhen Xia

Fengbin Fang

Sibao Hong

Yuzhang Li

A streaming application upgrading method and a stream computing system, where the method includes obtaining a updated logical model of a streaming application, determining a to-be-adjusted stream by comparing the updated logical model with an initial logical model, generating an upgrading instruction according to the to-be-adjusted stream, and delivering the generated upgrading instruction to a worker node such that the worker node adjusts, according to an indication of the upgrading instruction, a stream between process elements (PEs) distributed on the worker node. The method provided in the present disclosure can upgrade the streaming application online without interrupting a service.

Streaming application upgrading method, master node, and stream computing system

A streaming graph optimization method and apparatus are disclosed, relating to the stream processing field. A stream application streaming graph provided by a user is received and the streaming graph is parsed and a streaming graph described by an operator node and a data stream side is constructed. Additionally the streaming graph is disassembled according to a maximum atom division principle, so as to obtain at least one streaming subgraph and adjacency operator combination is performed on the at least one streaming subgraph according to a combination algorithm, so as to obtain an optimized streaming graph.

Method and apparatus for generating an optimized streaming graph using an adjacency operator combination on at least one streaming subgraph

A service scheduling method, applied to a stream computing system, is presented. The stream computing system includes a master control node and multiple working nodes, and the master control node is configured to schedule sub-services included in the service to the multiple working nodes for processing. The method includes acquiring a stream computing application graph of the service; dividing the stream computing application graph according to operator degrees and operator potentials of operators in the stream computing application graph and according to a division quantity for dividing the stream computing application graph, to obtain divided sub-graphs with the division quantity; and scheduling a sub-service corresponding to an operator included in each divided sub-graph to a working node corresponding to the divided sub-graph for processing. The method provided in embodiments of the present disclosure can enable services to use physical resources and network resources in a balanced manner.

Dividing a stream computing application graph of a service for scheduling and processing

An event processing method in a stream processing system includes matching a basic event with basic events stored in engine memories corresponding to each matching mode in a rule engine, to determine an engine memory including the basic event, and when it is determined that the engine memory including the basic event is an engine memory corresponding to a full-loop mode, inputting the basic event into the full-loop mode of the rule engine, adding a full-loop identifier to the basic event. This method implements classification processing on complex events by using different matching modes of the rule engine, improving performance of processing a complex event in an Event Stream Processing (ESP) service processing process.

Growing community of inventors

Shenzhen, China

Songshan Zhang