Bank of America Corporation

Sitaram C Yarlagadda

Vijaya M Anusuri

Jerome M Zott

Sridhar Ramaswamy

Faisal Azfar

Robert J Nicholson

Aspects of the disclosure relate to providing metadata access to distributed data lake users. In some embodiments, a computing platform may load metadata from an external metadata database into a staging database. Then, the computing platform may transform the metadata in the staging database and move the transformed metadata to a master database. The master database may comprise information indicating a relationship between the transformed metadata and one or more distributed data lakes. The computing platform may receive a request to access one or more metadata items. Then, the computing platform may authorize a distributed computing cluster user to access at least one metadata item based on the information. Based on the authorization, the computing platform may provide, to the distributed computing cluster user, access to the at least one metadata item of the one or more metadata items.

Metadata access for distributed data lake users

Aspects of the disclosure relate to enabling independent storage and processing of data with centralized event control. An event control computing platform may receive an indicator of a processing task associated with processing a dataset. Subsequently, the event control computing platform may authenticate the indicator of the processing task. Then the event control computing platform may identify and allocate resources for executing the processing task and storing the dataset. Finally, the event control computing platform may generate and transmit a series of commands to cause the dataset to be accessed by the processing platform, cause the processing task associated with the dataset to be executed, and cause the processed dataset to be stored on the storage platform.

Independent storage and processing of data with centralized event control

A method, apparatus, computer-readable medium, and/or system described herein may be used to efficiently store, move, and/or process data across a plurality of computing clusters. For example, a computing device may receive an indication of one or more data storage locations within a first cluster of servers and/or an indication of one or more data storage locations within a second cluster of servers. The computing device may generate a data file comprising the indication of the one or more data storage locations within the first cluster of servers and/or the indication of one or more data storage locations within the second cluster of servers. Based on the generated data file, the computing device may generate a job to move data stored at the one or more data storage locations within the first cluster of servers to the one or more data storage locations within the second cluster of servers. Based on the job, the computing device may transmit, e.g., to the first cluster of servers and/or the second cluster of servers, instructions to move data stored at the one or more data storage locations within the first cluster of servers to the one or more data storage locations within the second cluster of servers.

Growing community of inventors

Belmont, NC, United States of America

Sitaram C Yarlagadda