Citibank, N.a.

Prashant Praveen

Daniel Lewandowski

James Myers

Philip Davies

Payal Jain

Biraj Krushna Rath

Stuart Murray

Mariusz Saternus

Tariq Husayn Maonah

Chamindra Desilva

Vishal Mysore

Shardul Malviya

Samantha Cory

Deepak Jain

Wayne Liao

Sofia Rahman

Ramkumar Ayyadurai

Christopher Tucker

Miriam Silver

William Franklin Cameron

Prithvi Narayana Rao

Pramod Goyal

Manjit Rajaretnam

The systems and methods disclosed herein receive alphanumeric characters defining operative boundaries for expected model use cases, along with operational data. The expected model use cases share common attributes, which are used by a first AI model to construct observed model use cases from the operational data. Each observed model use case includes features such as a text-based description, expected input and output,? AI model(s) generating the expected output from the input, and/or data supporting the AI models. For each observed model use case, a second AI model maps the alphanumeric characters and features to a risk category, selecting from multiple risk categories based on the level of risk associated with the features. The system identifies criteria for the observed model use case within the alphanumeric characters and generates gaps by comparing the criteria with the features of the observed model use case.

Identifying and remediating gaps in artificial intelligence use cases using a generative artificial intelligence model

The systems and methods disclosed herein receive alphanumeric characters defining operative boundaries for expected model use cases, along with operational data. The expected model use cases share common attributes, which are used by a first AI model to construct observed model use cases from the operational data. Each observed model use case includes features such as a text-based description, expected input and output, AI model(s) generating the expected output from the input, and/or data supporting the AI models. For each observed model use case, a second AI model maps the alphanumeric characters and features to a risk category, selecting from multiple risk categories based on the level of risk associated with the features. The system identifies criteria for the observed model use case within the alphanumeric characters and generates gaps by comparing the criteria with the features of the observed model use case.

The systems and methods disclosed herein receives artifacts generated using a first set of models within a multi-model superstructure. The multi-model superstructure includes a second set of models to test the first set of models. The multi-model superstructure dynamically routes the artifacts of the first set of models to one or more models of the second set of models by (i) determining a set of dimensions of the artifacts against which to evaluate the artifacts and (ii) identifying the models in the second set used to test the particular dimension. The second set of models then assesses each artifact against a set of assessment metrics. If an artifact fails to meet one or more assessment metrics, the second set of models generates actions to align the artifact with the set of assessment metrics.

Dynamic multi-model monitoring and validation for artificial intelligence models

Growing community of inventors

New York, NY, United States of America

Prashant Praveen