Capital One Services, LLC

Alec Sokol

Saianirudh Kantabathina

Jose Moreno

Thomas J O'Connor

Daniel Liu

Samuel Joshua Bennett

Selwyn Lehmann

Patrick Ryan

Christopher Cellucci

Forrest Thomas

Richard Hightower

Michael Qiu

Scott Mandrell

Sathi Chowdhury

Navaneet Galagali

Mary Baum

David Woods

In some implementations, a system may receive information identifying a dataset. The system may process an identification attribute using a function that generates a first value, to generate a first identifier for the dataset. The system may search a data store storing a plurality of groupings to identify a grouping with the first identifier for the dataset. The system may extract a second identifier from the grouping with the first identifier for the dataset. The system may search a data lineage based graph representation of a plurality of datasets to identify a graph node representing the dataset. The system may update the data lineage based graph representation of the plurality of datasets to link the dataset with the at least one other dataset based on searching the data lineage based graph representation of the plurality of datasets to identify the graph node.

Dataset identification for datasets with multiple identification attributes

Disclosed herein are system, method, and computer program product embodiments for performing in-flight transformations of data streams. Complex event processing (CEP) operating on event records from various data streams can operate by storing the streamed event record data in a database, and then querying the data to perform a data transformation. However, in order to improve the performance of the data transformations and streamline CEP, a serverless architecture is introduced that can perform data transformations directly on streams, using attributes of the streamed record data defined in a schema. The resulting transformed data can then be provided by the serverless architecture to the CEP for direct access of the data most needed by the CEP.

In-flight transformations over a data stream

Growing community of inventors

San Francisco, CA, United States of America

Alec Sokol