Capital One Services, LLC

Janardhan Deepak Prabhakara

Parvesh Kumar

Gopi Kancharla

Raman Bajaj

Sanjiv Yajnik

Praveen Tandra

James Land

Susmitha Gangarapu

Behdad Forghani

Naga Venkata Sriram Vadakattu

Arjun Dugal

Abhijit Chitnis

Anurag Jain

Hanzhang Zheng

Haranatha Ijjurouthu

Mayur Jagtap

Mark Assousa

Rahul Surendra Nath

The exemplary embodiments provide real-time data capture and processing which improves data processing performance and speed and facilitate passing of the processed data to various analytical sources, while maintaining superior data quality checks, particularly with respect to data elements associated with multiple data types. The proposed system and process can be used to continuously consume and listen to multiple events while mapping the events to appropriate schemas provided in a separate schema stream. The schema stream is provided once and cached to minimize bandwidth consumed by the transaction stream. The schema information is then further enriched with information from a metadata registry. The event data may then be compressed and aligned in memory tables based on the enriched schema. Once events are decoded and sorted into memory tables in accordance to the identified schema, each memory table can be processed in parallel.

System, method and computer-accessible medium for capturing data changes

A set of computing nodes may receive a corresponding set of heartbeat messages that originated at the set of computing nodes. The set of heartbeat messages may relate to selecting, among the set of computing nodes, a leader computing node to process a set of jobs. State information included in the heartbeat messages may be provided to a leader election algorithm that outputs information indicating one or more computing nodes that are most qualified to process the set of jobs based on processing capabilities of the computing nodes and processing constraints associated with the set of jobs. The computing node may select itself as the leader computing node to process the set of jobs based on determining, from the information output by the leader election algorithm, that the computing node is most qualified to process the set of jobs and no other computing nodes are processing the set of jobs.

Computing node job assignment using multiple schedulers

A campaign server is disclosed which includes a multi-level queue architecture that isolates campaign processing from the delays and inconsistencies of target population information retrieval and a data streaming service system with latency and error remediation measures are disclosed, where the campaign server and the data consumption system can be part of a consolidated system. The data consumption system may include various components to process one or more offers to one or more customers and component configured to detect an error associated the preparation of the errors and/or ii) initiate a retry attempt to process the one or more offers, and/or storing an instruction in a storage component of the streaming data system to permanently prohibit an attempt to generate the one or more offers at a subsequent time if the retry attempt expires without processing the one or more offers.

System and method for minimizing latency in data consumption system

Growing community of inventors

Allen, TX, United States of America

Janardhan Deepak Prabhakara