International Business Machines Corporation

Xin Qian

Weng Sing Tang

Tien Hiong Lee

Konstantin Levinski

Harjoben Singh

Xiang Zhang

Christopher G Fredericks

A mechanism is provided for detecting one or more defects in an incoming log. One or more features are extracted from the incoming log. Utilizing the one or more features, one or more patterns, one or more pattern sequences of the one or more patterns, and one or more proximities associated with the one or more patterns contained in the incoming log are identified. For each defect model generated for the incoming log, a set of patterns in the defect model is compared to a set of patterns in each previously identified defect model in a set of previously identified defect models. Responsive to identifying a match and responsive to set of scores associated with the match meeting or exceeding a set of probability thresholds, an identification associated with the previously identified defect model along with any solution or workaround is passed to a support engineer.

Probabilistic detect identification

Embodiments of the present invention disclose populating a database by conducting a training phase to analyze training security log streams. A server extracts the words contained within the training security log and replaces each of the extracted words with a symbol to form a symbol string and an n-gram scan is conducted on the symbol string to generate statistical data. Tokens are extracted from symbol string, where the tokens are words, phrase or alphanumeric sequence represented by a symbol within training security log stream. The symbol string is replaced with the words they represent to allow for the identification of the actual token phrases. A scan is conducted on the token phrase to acquire scan data on the identified token phrases. Once the tokens, position information, and scan data are known they are stored within the database to allow security log streams to be analyzed in real time.

System and method for field extraction of data contained within a log stream

Growing community of inventors

Singapore, Singapore

Xin Qian