International Business Machines Corporation

Jing James Xu

Xue Ying Zhang

Si Er Han

Ji Hui Yang

Damir Spisic

Xiao Ming Ma

Jing-Yun Shyr

Jun Wang

Jun Song Wang

Lei Gao

A Peng Zhang

Wen Pei Yu

Dakuo Wang

Xing Wei

Sier Han

Jin Wang

Dong Hai Yu

Bei Chen

Chuang Gan

Steven G Barbee

Fan Li

Dhavalkumar C Patel

Yea Jane Chu

Syed Yousaf Shah

Xiaoyang Yang

Jing Xu

Rui Wang

Yi Shao

Jian Jun Wang

Lei Tian

Yuan Feng

Peter Daniel Kirchner

Horst Cornelius Samulowitz

Chun Lei Xu

Long H Vu

Yang Zhang

Yao Dong Liu

Saket Sathe

Gregory Bramble

Xuan-Hong Dang

Juan Wu

Ling Zhuo

Peng Xue

Svetlana Levitan

Long Fan

Ye Fan

Xueying Zhang

John Dillon Eversman

Voranouth Supadulya

Yan Yan Han

Qi Mao

Marius I Danciu

Raymond Wright

Michael McRoberts

Yue Wang

Liang Wang

Yi Shan Jiang

Kai Lin Li

Ke Wei Wei

Graham John Wills

Lingfei Wu

Petros Zerfos

Li Cao

Thanh Lam Hoang

Jun Yang

Craig Reginald Tomlyn

Wesley M Gifford

Yi Dai

Guang Ming Zhang

Arunima Chaudhary

Abel Nicolas Valente

Jiang Bo Kang

Shuang Ys Yu

Ze Ming Zhao

Ying Lin Xu

Yan Zhao Liu

Tao Wen

Daniel Karl I Weidele

Jin Rong Wang

Song Bo

Lin Ju

Xin Feng Zhu

Hui Lin

Yi Wang

Yang Y Yang

Yang Yang

Bo Shen

Yun Bo Zhang

Lin Yan Wu

Long Vu

Xuye Liu

Jishuo Yang

Fei Fan

Ang Chang

Su Li Hou

Tian Jiao Zhang

Kai Xa Li

Jing Jia

Jun Qi Zhang

Data segmentation, analysis, and security is provided. An analysis of a set of generated data evolution paths corresponding to a set of data collected over a defined span of time is performed. A behavior trend is determined based on analysis of the set of generated data evolution paths. A set of action steps is performed automatically based on the determined behavior trend.

Taking action based on data evolution

One or more computer processors group a plurality of predictors contained in training data into a plurality of predictor groups. The one or more computer processors create a plurality of sample sets, wherein each sample set in the plurality of sample sets contains one or more predictors selected from a respective predictor group in the plurality of predictor groups. The one or more computer processors create a cluster model for each created sample set in the plurality of created sample sets. The one or more computer processors generate a score for a record with one or more missing values utilizing at least one created cluster model of the created cluster models and at least one created sample set of the created sample sets.

Intelligent scoring of missing data records

A computer-implemented method for treating post-modeling data includes computing, sequentially for each category of a feature, a category importance (CI) value. The CI value is based on a model accuracy change when records of a category being examined are reassigned to a remaining set of categories of the feature according to a cumulative distribution of records among the remaining set of categories of the feature, wherein the remaining set of categories include all categories of the feature, except for the category being examined. A post-modeling category is performed to merge of each category having the CI value less than a CI value threshold.

Key category identification and visualization

In an approach for post-modeling data visualization and analysis, a processor presents a first visualization of a training dataset in a first plot. Responsive to receiving a selection of a data group of the training dataset to analyze, a processor identifies three or fewer key model features of the data group of the training dataset. A processor ascertains a representative record of each key model feature of the three or fewer key model features using a Local Interpretable Model-Agnostic Explanation technique. A processor presents a second visualization of the three or fewer key model features and the representative record of each key model feature in a second plot.

Visualize data and significant records based on relationship with the model

A method, computer system, and a computer program product are provided for post-modeling feature evaluation. In one embodiment, at least at least one post model visual output and associated data is obtained that at least includes an individual conditional expectation (ICE) plot and a partial dependence (PDP) plot. Using the associated data and the plots, a Feature Importance (PI) plot is provided. A plurality of features is then determined for each PI, PDP and ICE plots to calculate at least one Interesting Value for each plot. An overall score is also calculated for each plurality of features based on the associated Interesting Values for each PDP, ICE and PI plots. At least one top feature is selected based on said scores. A final plot is then generated at least reflecting the top feature. The final plot combines the PI, PDP and ICE plots together.

Visual representation using post modeling feature evaluation

Disclosed are a computer-implemented method, a system and a computer program product for model exploration. Model feature importance of each model of a plurality of models can be obtained, the plurality of models can be grouped into a plurality of model clusters based on the model feature importance of each model, and the model feature importance can be presented by box-plot or confidence interval.

Feature importance based model optimization

Mechanisms are provided for intelligently identifying an execution environment to execute a computing job. An execution time of the computing job in each execution environment of a plurality of execution environments is predicted by applying a set of existing machine learning models matching execution context information and key parameters of the computing job and execution environment information of the execution environment. The predicted execution time of the machine learning models is aggregated. The aggregated predicted execution times of the computing job are summarized for the plurality of execution environments. Responsive to a selection of an execution environment from the plurality of execution environments based on the summary of the aggregated predicted execution times of the computing job, the computing job is executed in the selected execution environment. Related data during the execution of the computing job in the selected execution environment is collected.

Intelligent identification of an execution environment

Embodiments of the present disclosure relate to a method, system, and computer program product for efficient execution of a decision tree. According to the method, respective target values of a plurality of attributes of a target entity are obtained. Representations of a plurality of leaf nodes of a decision tree are obtained. Each of the representations indicates respective statistic values of a plurality of attributes of historical entities and a statistic prediction result determined from historical prediction results output at a respective one of the plurality of leaf nodes for the historical entities. Distance measures between the target entity and the plurality of leaf nodes are determined based on the target values and the statistic values indicated by the representations of the plurality of leaf nodes. A target prediction result for the target entity is determined based on the distance measures and the statistic prediction results of the historical entities.

Efficient execution of a decision tree

A method for identifying influential effects that contribute most to a status change of a target index for goal seeking analysis. The method includes generating a candidate list of significant changed predictors between the normal and abnormal status time periods in collected data, and building a plurality of regression models from the collected data. The method determines a first value (trend value or Pearson correlation value) for each of the significant changed predictors based on whether at least one of the significant changed predictors have a significant change trend using the regression models. The method obtains a second predictor importance value for each of the significant changed predictors from a single model built on all the collected data. The method generates a final predictor value for each of the significant changed predictors by combining the first value with the second predictor importance value for each of the significant changed predictors.

Identifying influential effects to be adjusted in goal seek analysis

Performing predictive analysis on running batch jobs is provided. A series of batch end time predictive models is retrieved according to a sequence of milestone jobs in a batch of jobs. Retrieved batch end time predictive models are assembled into an aggregate batch end time predictive model to increase accuracy and stability of an end time prediction of the batch of jobs. The aggregate batch end time predictive model is utilized to predict an end time of the batch of jobs during running of the batch of jobs to form a predicted end time of the batch of jobs.

Predictive analysis on running batch jobs

An embodiment generates an initial set of training data from monitoring data. The initial set of training data is generated by combining outputs from a plurality of pretrained classifiers. The embodiment trains a new classification model using the initial set of training data to identify anomalies in monitoring data. The embodiment performs a multiple-level clustering of the data samples resulting in a plurality of clusters of sub-clusters of data samples, and generates a review list of data samples by selecting a representative data sample from each of the clusters. The embodiment receives an updated data sample from the expert review that includes a revised target classification for at least one of the data samples of the expert review list. The embodiment then trains another replacement classification model using a revised set of training data that includes the updated data sample and associated revised target classification.

Intelligent expansion of reviewer feedback on training data

Using a set of menu to key process mappings, historical menu usage data for an application is aggregated into aggregated key process usage data. A set of key process association rules, each comprising a consequent key process given a particular antecedent key process, is generated. From the set of key process association rules and a set of ranked menus by frequency of usage within each key process, a set of model menu recommendations is generated. According to an application usage history, a menu frequency ratio, and a confidence value of a modelled next menu, the set of menu recommendations is scored. A scored menu recommendation having a rank below a threshold rank is pruned from a set of menu items of the application ranked according to their scores. The pruned set of scored menu recommendations is presented for selection instead of the set of menu items.

Behavior based menu item recommendation and pruning

An approach is provided in which the approach builds a combination model that includes a normal status model and an abnormal status model. The normal status model is built from a set of time-sequenced normal status records and the abnormal status model is built from a set of time-sequenced abnormal status records. The approach computes a set of time-sequenced coefficient combination values of the normal status model and the abnormal status model based on applying a set of fitting coefficient characteristics to the normal status model and the abnormal status model. The approach performs goal seek analysis on a system using the combination model and the set of time-sequenced coefficient combination values.

Goal seek analysis based on status models

To automate time series forecasting machine learning pipeline generation, a data allocation size of time series data may be determined based on one or more characteristics of a time series data set. The time series data may be allocated for use by candidate machine learning pipelines based on the data allocation size. Features for the time series data may be determined and cached by the candidate machine learning pipelines. Predictions of each of the candidate machine learning pipelines using at least the one or more features may be evaluated. A ranked list of machine learning pipelines may be automatically generated from the candidate machine learning pipelines for time series forecasting based upon evaluating predictions of each of the one or more candidate machine learning pipelines.

Automated time series forecasting pipeline generation

Embodiments of the present disclosure relate to a method, system and computer program product for semantic search based on a graph database. In some embodiments, a method is disclosed. According to the method, the user jobs of a user are obtained from a first software product. Based on the user jobs, target test cases are selected from a plurality of test cases associated with the first software product and a second software product. The target test cases are applied to the first software product and the second software product, and in accordance with a determination that a result of applying the target test cases satisfies a predetermined criterion, an instruction is provided to indicate migrating from the first software product to the second software product. In other embodiments, a system and a computer program product are disclosed.

Migration between software products

Growing community of inventors

Xi'an, China

Jing James Xu