Sift Science, Inc.

Alex Paino

Fred Sadaghiani

Jacob Burnim

Keren Gu

Noah Grant

Eugenia Ho

Gary Lee

Doug Beeferman

Thomas Schiavone

Vera Dadok

Janice Lan

Aaron Beppu

A machine learning-based system and method for identifying digital threats that includes implementing a machine learning-based digital threat mitigation service over a distributed network of computers; constructing, by the machine learning-based digital threat mitigation service, a subscriber-specific machine learning ensemble that includes a plurality of distinct machine learning models, wherein each of the plurality of distinct machine learning models is configured to perform a distinct machine learning task for identifying a digital threat or digital fraud; constructing a corpus of subscriber-specific digital activity data for training the plurality of distinct machine learning models of the subscriber-specific ensemble; training the subscriber-specific ensemble using at least the corpus of subscriber-specific digital activity data; and deploying the subscriber-specific ensemble.

Systems and methods configuring a subscriber-specific ensemble of machine learning models

Systems and methods include: collecting digital threat scores of an incumbent digital threat machine learning model; identifying incumbent and successor digital threat score distributions; identifying quantiles data of the incumbent digital threat score distribution; collecting digital threat scores of a successor digital threat machine learning model; calibrating the digital threat scores of the successor digital threat score distribution based on the quantiles data of the incumbent digital threat score distribution and the incumbent digital threat score distribution; and in response to remapping the digital threat scores of the successor digital threat score distribution, publishing the successor digital scores in lieu of the incumbent digital threat scores based on requests for digital threat scores.

Systems and methods for calibrating a machine learning model

Systems and methods include: collecting digital event data for the digital account; using a trained machine learning model to extract account takeover (ATO) risk features from the collected digital event data; evaluating the extracted ATO risk features of the collected digital event data of the digital account against a plurality of ATO risk heuristics; identifying one or more of the plurality of ATO risk heuristics that is triggered by the extracted ATO risk features, wherein one or more of the plurality of ATO risk heuristics may be triggered if at least a subset of the extracted ATO risk features matches requirements of the one or more ATO risk heuristics; and generating an ATO risk assessment for the digital account using the one or more triggered ATO risk heuristics.

System and methods for digital account threat detection

Systems and methods include implementing a remote machine learning service that collects digital event data; collecting incumbent digital threat scores generated by an incumbent machine learning model and successor digital threat scores generated by a successor digital threat machine learning (ML) model; implementing anomalous-shift-detection that detects whether the successor digital threat scores of the successor digital threat ML model produces an anomalous shift; if the anomalous shift is detected by the machine learning model validation system, blocking a deployment of the successor digital threat model to a live ensemble of digital threat scoring models; or if the anomalous shift is not detected by the machine learning model validation system, deploying the successor digital threat ML model by replacing the incumbent digital threat ML model in a live ensemble of digital threat scoring models with the successor digital threat ML model.

Systems and methods detecting and mitigating anomalous shifts in a machine learning model

Systems and methods include: implementing a first machine learning model to generate an output of a global digital threat score for an online activity based on an input of the collected digital event data; implementing a second machine learning model that generates a category inference of a category of digital fraud or a category of digital abuse from a plurality of digital fraud or digital abuse categories; selecting a third machine learning model from an ensemble of digital fraud or digital abuse machine learning models based on the category inference generated by the second machine learning model, wherein the ensemble of digital fraud or digital abuse machine learning models comprise a plurality of disparate digital fraud or digital abuse category-specific machine learning models; and implementing the selected third machine learning model to generate a digital fraud or digital abuse category-specific threat score based on the digital event data.

System and methods for dynamic digital threat mitigation

Systems and methods include: collecting digital event data from at least one remote source of digital event data; using the collected digital event data as input into primary machine learning ensemble that predicts the likelihood of digital fraud and/or digital abuse; generating by the machine learning system the global digital threat score; identifying a sub-request for a specific digital threat score for a digital abuse type; in response to identifying the sub-request, providing the input of the collected digital event data to a secondary machine learning model ensemble of the machine learning system that predicts a likelihood of the identified digital abuse type; generating by the secondary machine learning ensemble the specific digital threat score for the digital abuse type based on the input of the collected digital event data; and transmitting the global digital threat score and the specific digital threat score for the identified digital abuse type.

Growing community of inventors

San Francisco, CA, United States of America

Alex Paino