Wells Fargo Bank, N.a.

Bank of America Corporation

Ford Motor Company Limited

Agus Sudjianto

Jie Chen

Harsh Singhal

Vijayan Narayana Nair

William Anthony Nobili

Tarun Joshi

Timothy John Breault

Aijun Zhang

Naveen Gururaja Yeri

Arun Pinto

Sandi Setiawan

Fernando Cela Diaz

Meghan Alita Steach

Benhong Zhang

Zhe Zhang

Shutian Zeng

Yiping Zhuang

Rao Fu

Wayne B Shoumaker

Weicheng Liu

Rahul Singh

Kevin D Oden

Mahesh Vora

Richard Liu

Kaloyan Mihaylov

Mina Naghshnejad

Hungien Wang

Xiaoyu Liu

Haojie Wang

Michael Chorba

Daniel Hudson

Jocelyn Sikora

Kiran Vuppu

Han Chen

Angelina Yang

Kurt Schieding

Linwei Hu

Joel Vaughan

Ye Yu

Ningzhou Zeng

Suhas Sreehari

Qi Shen

Nathan R Soderborg

Misty Ritchie

Elaine C Marino

Matthew R Quinn

Peter C Richards

Michelle Warholic

Kai Arne Krueger

Harsh Vardhan Tiwari

Karan H Jeswani

John Delmonico

Zebin Yang

Shelly X Ennis

Ruilong He

Glenn B Jones

WeiCheng Liu

Shuchun Wang

Hungjen Wang

Liem Ferryanto

Steve C Wang

David John Buche

Dingjun Li

Ridhi Puppala

Ulrich A Bruns

Siyuan Jiang

Xiaoping Liu

Andrea Renee Turner

Bradford Timothy Winkelman

Peter B Vechnak

Disclosed is an example approach in which network and non-network features are used to train a predictive machine learning model that is implemented to predict financial crime and fraud. Graphical network features may be generated by applying financial entity risk vectors to a network model with representations of various types of networks. The network model may comprise transactional, non-social, and/or social networks, with edges corresponding to linkages that may be weighted according to various characteristics (such as frequency, amount, type, recency, etc.). The graphical network features may be fed to the predictive model to generate a likelihood and/or prediction with respect to a financial crime. A perceptible alert is generated on one or more computing devices if a financial crime is predicted or deemed sufficiently likely. The alert may identify a subset of the set of financial entities involved in the financial crime and present graphical representations of networks and linkages.

Network based features for financial crime detection

Computing systems and technical methods that transform data structures and pierce opacity difficulties associated with complex machine learning algorithms are disclosed. Advances include a framework and techniques that include: i) global diagnostics; ii) locally interpretable models LIME-SUP-R and LIME-SUP-D; and iii) explainable neural networks.

Resolving opaqueness of complex machine learning applications

Systems, apparatuses, methods, and computer program products are disclosed for generating a single-index model (SIM) tree. An example method includes receiving a data set and a maximum tree depth. The example method further includes screening a set of variables from the data set to form split variables. The method may include, while maximum tree depth has not been reached, (i) generating a fast SIM estimation for nodes of a tree level, (ii) for each node, selecting a split point and split variable based on the fast SIM estimation, (iii) based on the selected split points and split variables, generating nodes for a next tree level, each including a subset of data, and (iv) repeating steps (i), (ii), and (iii). The method may include fitting a SIM for each leaf node at maximum tree depth based on a subset of the data set represented by the leaf node.

Systems and methods for generating a single-index model tree

This disclosure describes techniques that include validation or other assessments of digital systems, such as machine learning models and other statistical models. In one example, this disclosure describes a method that includes receiving, by a validation computing system and from a development system, a request to perform a test on a model configured to execute on the development system; outputting, by the validation computing system to the development system and in response to the request, an instruction; enabling the development system to process the instruction; receiving, by the validation computing system, test response data; evaluating, by the validation system, the test response data.

Model validation as a service

Systems, apparatuses, methods, and computer program products are disclosed for determining robustness information for an NLP model. Modification rules, such as replacement rules and/or insertion rules, are used to generate instances of modified test data based on instances of test data that comprise words and have a syntax and a semantic meaning. The instances of test data and modified test data are provided to the NLP model and the output of the NLP model is analyzed to determine output changing instances of modified test data, which are instances of modified test data yielded output from the NLP model that is different and/or not similar to the output yielded from the NLP model for the corresponding instance of test data. Robustness information for the NLP model is determined based at least in part on the output changing instances of modified test data.

Systems and methods for natural language processing (NLP) model robustness determination

Systems, apparatuses, methods, and computer program products are disclosed for screening data instances based on a target text of a target corpus. A screening device analyzes a target corpus to generate at least two term dictionaries for the target corpus. The screening apparatus, based on a frequency of a term in the target corpus, determines a term weight for the term; for each data instance, determines term scores for the data instance and the target text based on the term weights; filters the data instances based on the term scores, to generate a short list of data instances; determines term similarity scores between each data instance of the short list and target text based on the term weights; and provides a data instance determined to likely correspond to the target text and an indication of the corresponding term similarity score(s). A term is a word or an n-gram.

Systems and methods for screening data instances based on a target text of a target corpus

The innovation disclosed and claimed herein, in one aspect thereof, comprises systems and methods of validating models guided by machine learning algorithms. The innovation can begin by receiving a risk model for validation having multiple sets of data. A first data set is selected from as an input. Outputs are generated for validation. One output can be generating a second set of analysis results using a comparable algorithm to the risk model. Another output can be generating a second set of variables and transformations using a machine learning algorithm and an untransformed set of the selected variables to assess the set of selected transformations. Another output can be generating a third set of variables using one or more machine learning algorithms and an extended feature set of variables to assess the selected variables. The outputs are compared to the analysis results, coefficients, selected variables, and selected transformations. A report of the comparison is generated.

Model validation of credit risk

Systems, apparatuses, methods, and computer program products are disclosed for generating time series. A time series simulator receives information corresponding to a request for time series. The information is formatted into input data by the time series simulator. The input data comprises at least one continuous condition. A generator network of the continuous condition generative adversarial network (CCGAN) generates the time series based directly on a value of the at least one continuous condition. The time series is provided such that the time series is at least one of (a) provided as input to an analysis pipeline or (b) received by a user computing device wherein a representation of at least a portion of the one or more time series is provided via an interactive user interface of the user computing device.

Systems and methods for time series simulation

Systems, apparatuses, methods, and computer program products are disclosed for determining robustness information for an NLP model. Modification rules, such as replacement rules and/or insertion rules, are used to generate instances of modified test data based on instances of test data that comprise words and have a syntax and a semantic meaning. The instances of test data and modified test data are provided to the NLP model and the output of the NLP model is analyzed to determine output changing instances of modified test data, which are instances of modified test data yielded output from the NLP model that is different and/or not similar to the output yielded from the NLP model for the corresponding instance of test data. Robustness information for the NLP model is determined based at least in part on the output changing instances of modified test data. White and/or black box attacks may be performed.

Systems, apparatuses, methods, and computer program products are disclosed for pricing a callable instrument. A plurality of corresponding pairs of Brownian motion paths and index value paths are determined corresponding to a set of dates. A deep neural network (DNN) of a backward DNN solver is trained until a convergence requirement is satisfied by for each pair of corresponding Brownian motion path and index value path, using the backward DNN solver to determine by iterating in reverse time order from a final discounted option payoff to an initial value. A statistical measure of spread of a set of initial values is determined and parameters of the DNN are modified based on the statistical measures of spread. Pricing information is determined by the backward DNN solver and provided such that a representation thereof is provided via an interactive user interface of a user computing device.

Systems and methods for callable options values determination using deep machine learning

Computing systems and technical methods that transform data structures and pierce opacity difficulties associated with complex machine learning modules are disclosed. Advances include a framework and techniques that include: i) global diagnostics; ii) locally interpretable models LIME-SUP-R and LIME-SUP-D; and iii) explainable neural networks. Advances also include integrating LIME-SUP-R and LIME-SUP-D approaches that create a transformed data structure and replicated modeling over local and global effects and that yield high interpretability along with high accuracy of the replicated complex machine learning modules that make up a machine learning application.

Growing community of inventors

Matthews, NC, United States of America

Agus Sudjianto