Amazon Technologies, Inc.

Michal Marshall

Rama Krishna Sandeep Pokkunuri

Vivek Bhadauria

Kalpesh N Sutaria

Enrico Sartorello

Yong Yuan

Karthik Ravindra Rao

Raghu Chaitanya Puligilla

Hammad Latif Mirza

Kshitiz Mohan Agarwal

Paul Matthew Kohan

Ameer Nizarsami Ayoub

A data set management of a provider network may allow a user to create new data set instances. When a data set instance is created, data set lineage metadata is also generated to describe the new data set instance, including the transformation that was applied to data in order to create the data set instance. When modifications are made to source data (e.g., a data bucket), then the modifications are propagated via transformations to the parent data set instance and to any child data set instances according to the data set lineage metadata in order to update the data set instances. When modifications are made to a parent data set instance to create an updated parent data set instance, then the modifications are propagated via transformations to any child data set instances according to the data set lineage metadata. Transformations and transformation patterns may also be defined and scheduled.

Data set management using data set lineage metadata

Growing community of inventors

Seattle, WA, United States of America

Michal Marshall