American Express Travel Related Services Company, Inc.

Marimuthu Ponnambalam

Sandeep Bose

Matthew Kent Meyer

Jeremy David Seideman

Ravi Arasan

Gurusamy Ramasamy

Carmen Patricia Argüello

Mohammad Torkzahrani

Roopesh R Varier

Debasish Das

Ravi K Kaushik

Kunal Chandrashekhar Joshi

Ambika Aggarwal

Himanshu Prabhakar

A system may receive a request for access to a first variable. The request may include a requested action and a variable identifier for the first variable. The request may also have a syntax that is incompatible with first data storage format. The system may parse the request to capture the variable identifier from the request. The system may also look up a location of the first variable in a catalog using the variable identifier. The location of the first variable may include the first data storage format. The system may generate a query to access the first variable. The syntax of the query may be compatible with the first data storage format. The system may then submit the query to access the first data storage format. The query may be configured to complete the requested action.

Querying in big data storage formats

A system may store a plurality of first records comprising a first variable in a first data storage format. The system may also store a plurality of second records comprising a second variable in a second data storage format. The first data storage format may have a different data structure than the second data storage format. The system may then generate a catalog including a first location of the first variable and a second location of the second variable. The first location identifies the first data storage format, which is where the first variable is stored. The second location identifies the second data storage format, which is where the second variable is stored. The system may then receive a request to access at least one of the first variable or the second variable and access the first variable and/or the second variable in response to the request.

Catalog with location of variables for data

A system may receive a request to derive an output variable from a source variable. The request may include proposed logic to derive the output variable from the source variable. The system may then compare the proposed logic to existing logic to determine the proposed logic is new. In response to the proposed logic being new, the system may generate transformation code configured to execute the proposed logic. The system may further schedule the transformation code for execution at a predetermined time, and then execute the transformation code to generate data for the output variable.

Data transformations with metadata

A system may receive a request for access to a first variable. The request may include a requested action and a variable identifier for the first variable. The request may also have a syntax that is incompatible with first data storage format. The system may parse the request to capture the variable identifier from the request. The system may also look up a location of the first variable in a catalog using the variable identifier. The location of the first variable may include the first data storage format. The system may generate a query to access the first variable. The syntax of the query may be compatible with the first data storage format. The system may then submit the query to the first data storage format. The query may be configured to complete the requested action.

System and method for reading and writing to big data storage formats

Integrated big data interface for multiple storage types

System and method transforming source data into output data in big data environments

Growing community of inventors

Phoenix, AZ, United States of America

Marimuthu Ponnambalam