Servicenow, Inc.

Other

Dxcontinuum Inc.

Konfer, Inc.

Baskar Jayaraman

Kannan Govindarajan

Aniruddha Madhusudan Thakur

Chitrabharathi Ganapathy

Debashish Chatterjee

Sriram Palapudi

Shiva Shankar Ramanna

Ganesh Rajan

Jun Wang

Nikhil Prashant Bendre

Fernando Ros

Firat Karakusoglu

Dinesh Kumar Kishorkumar Surapaneni

Tao Feng

Robert Bitterfeld

Asaf Garty

Tao Hong

Rohit Lobo

Venu Madhav Matcha

Hongqiao Li

Andrew Kai Chiu Wong

Aniruddha Madhusudhan Thakur

Matthew Lawrence Watkins

Kanaan Govindarajan

Debashsish Chatterjee

A method and a system for the automatic discovery of AI/ML models, their parameters, data input and output specifications, and data transforms in a production code repository using Artificial Intelligence/Machine Learning are disclosed. A method and system for automatic discovery of the location, identification, classification, and definition of the AI/ML models, their parameters, data input and output specifications, and data transforms in the production code repository using Artificial Intelligence/Machine Learning are also disclosed. The method and system utilize a plurality of source codes from a plurality of sources, such as open-source AI/ML libraries with the source codes, non-open-source AI/ML libraries, and tagged/pre-classified code, in conjunction with a production code repository, to identify the method of working on the plurality of source codes using Artificial Intelligence/Machine Learning.

Method and system for automated discovery of artificial intelligence (AI)/ machine learning (ML) assets in an enterprise

Systems and methods involving data structures for efficient management of paragraph vectors for textual searching are described. A database may contain records, each associated with an identifier and including a text string and timestamp. A look-up table may contain entries for text strings from the records, each entry associating: a paragraph vector for a respective unique text string, a hash of the respective unique text string, and a set of identifiers of records containing the respective unique text string. A server may receive from a client device an input string, compute a hash of the input string, and determine matching table entries, each containing a hash identical to that of the input string, or a paragraph vector similar to one calculated for the input string. A prioritized list of identifiers from the matching entries may be determined based on timestamps, and the prioritized list may be returned to the client.

Data structures for efficient storage and updating of paragraph vectors

A document is received. The document is analyzed to discover text and structures of content included in the document. A result of the analysis is used to determine intermediate text representations of segments of the content included in the document, wherein at least one of the intermediate text representations includes an added text encoding the discovered structure of the corresponding content segment within a structural layout of the document. The intermediate text representations are used as an input to a machine learning model to extract information of interest in the document. One or more structured records of the extracted information of interest are created.

Determination of intermediate representations of discovered document structures

An embodiment may involve persistent storage containing a machine learning trainer application configured to apply one or more learning algorithms. One or more processors may be configured to: obtain alert data from one or more computing systems; generate training vectors from the alert data, wherein elements within each of the training vectors include: results of a set of statistics applied to the alert data for a particular computing system of the one or more computing systems, and an indication of whether the particular computing system is expected to fail given its alert data; train, using the machine learning trainer application and the training vectors, a machine learning model, wherein the machine learning model is configured to predict failure of a further computing system based on operational alert data obtained from the further computing system; and deploy the machine learning model for production use.

Failure prediction in a computing system based on machine learning applied to alert data

An embodiment may include a machine learning based classifier that maps input observations into respective categories and a database containing a corpus of training data for the classifier. The training data includes a plurality of entries, each entry having an observation respectively associated with a ground truth category thereof. A computing device may be configured to select, from the training data, a plurality of subsets each containing a different number of entries. The computing device may also be configured to, for each particular subset: (i) divide the particular subset into a training portion and a validation portion, (ii) train the classifier with the training portion, (iii) provide the validation portion as input to the classifier as trained, and (iv) based on how entries of the validation portion are mapped to the categories, determine a respective precision for the particular subset.

Machine learning classification with model quality prediction

The embodiments herein provide a framework for and specific implementations of machine learning (ML) analysis of incident, online chat, knowledgebase, skills, and perhaps other types of databases. The ML techniques described herein may include various forms of semantic analysis of textual information in these databases, such as clustering, term frequency, word embedding, paragraph embedding, and potentially other techniques. Advantageously, use of ML in the specific ways described herein can provide insights into this textual information that otherwise would be impossible to determine in an accurate or concise fashion.

Determining semantic content of textual clusters

A network system may include a plurality of trainer devices and a computing system disposed within a remote network management platform. The computing system may be configured to: receive, from a client device of a managed network, information indicating (i) training data that is to be used as basis for generating a machine learning (ML) model and (ii) a target variable to be predicted using the ML model; transmit an ML training request for reception by one of the plurality of trainer devices; provide the training data to a particular trainer device executing a particular ML trainer process that is serving the ML training request; receive, from the particular trainer device, the ML model that is generated based on the provided training data and according to the particular ML trainer process; predict the target variable using the ML model; and transmit, to the client device, information indicating the target variable.

Machine learning with distributed training

A remote network management platform is provided that includes an end-user computational instance dedicated to a managed network, a training computational instance, and a prediction computational instance. The training instance is configured to receive a corpus of textual records from the end-user instance and to determine therefrom a machine learning (ML) model to determine the numerical similarity between input textual records and textual records in the corpus of textual records. The prediction instance is configured to receive the ML model and an additional textual record from the end-user instance, to use the ML model to determine respective numerical similarities between the additional textual record and the textual records in the corpus of textual records, and to transmit, based on the respective numerical similarities, representations of one or more of the textual records in the corpus of textual records to the end-user computational instance.

Centralized machine learning predictor for a remote network management platform

A computer-implemented method includes obtaining a plurality of textual records divided into clusters and a residual set of the textual records, where a machine learning (ML) clustering model has divided the plurality of textual records into the clusters based on a similarity metric. The method also includes receiving, from a client device, a particular textual record representing a query and determining, by way of the ML clustering model and based on the similarity metric, that the particular textual record does not fit into any of the clusters. The method additionally includes, in response to determining that the particular textual record does not fit into any of the clusters, adding the particular textual record to the residual set of the textual records. The method can additionally include identifying, by way of the ML clustering model, that the residual set of the textual records contains a further cluster.

Clustering and dynamic re-clustering of similar textual documents

A database contains a corpus of incident reports, a machine learning (ML) model trained to calculate paragraph vectors of the incident reports, and a look-up set table that contains a list of paragraph vectors respectively associated with sets of the incident reports. A plurality of ML worker nodes each store the look-up set table and are configured to execute the ML model. An update thread is configured to: determine that the look-up set table has expired; update the look-up set table by: (i) adding a first set of incident reports received since a most recent update of the look-up set table, and (ii) removing a second set of incident reports containing timestamps that are no longer within a sliding time window; store, in the database, the look-up set table as updated; and transmit, to the ML worker nodes, respective indications that the look-up set table has been updated.

Machine learning worker node architecture

A system may include memory containing: (i) a master data set representable in columns and rows, and (ii) a query expression. The system may include a software application configured to apply a machine learning (ML) pipeline to an input data set. The system may include a computing device configured to: obtain the master data set and the query expression; apply the query expression to the master data set to generate a test data set, where applying the query expression comprises, based on content of the query expression, generating the test data set to have one or more columns or one or more rows fewer than the master data set; apply the ML pipeline to the test data set, where applying the ML pipeline results in either generation of a test ML model from the test data set or indication of an error in the test data set; and delete the test data set from the memory.

Data set generation for testing of machine learning pipelines

Word vectors are multi-dimensional vectors that represent words in a corpus of text and that are embedded in a semantically-encoded vector space; paragraph vectors extend word vectors to represent, in the same semantically-encoded space, the overall semantic content and context of a phrase, sentence, paragraph, or other multi-word sample of text. Word and paragraph vectors can be used for sentiment analysis, comparison of the topic or content of samples of text, or other natural language processing tasks. However, the generation of word and paragraph vectors can be computationally expensive. Accordingly, word and paragraph vectors can be determined only for user-specified subsets of fields of incident reports in a database.

Selectively generating word vector and paragraph vector representations of fields for machine learning

Identifications of program processes executing on an information technology environment are received. The identified program processes are clustered into a plurality of different groups. Identifications of interactions between at least a portion of the program processes are received. The identified interactions are analyzed to determine one or more interaction metrics between different group pairs in the plurality of different groups. A graph representation that includes at least a portion of the plurality of different groups as graph nodes in the graph representation is generated. The graph representation includes one or more graph edges determined to be included based on the one or more interaction metrics.

Generating a representation of program processes executing on an information technology environment

Word vectors are multi-dimensional vectors that represent words in a corpus of text and that are embedded in a semantically-encoded vector space. Word vectors can be used for sentiment analysis, comparison of the topic or content of sentences, paragraphs, or other passages of text or other natural language processing tasks. However, the generation of word vectors can be computationally expensive. Accordingly, when a set of word vectors is needed for a particular corpus of text, a set of word vectors previously generated from a corpus of text that is sufficiently similar to the particular corpus of text, with respect to some criteria, may be re-used for the particular corpus of text. Such similarity could include the two corpora of text containing the same or similar sets of words or containing incident reports or other time-coded sets of text from overlapping or otherwise similar periods of time.

Growing community of inventors

Fremont, CA, United States of America

Baskar Jayaraman