Trifacta Inc.

Edward Eli Marschner

Adam Silberstein

Sean Philip Kandel

Alon Bartur

Philip John Vander Broek

Wei Zheng

Chris Beavers

A data preprocessing system builds transformation scripts for preprocessing datasets for processing by a data analysis system. The data preprocessing system presents various representations of data of a dataset including visual representations, textual representations, or structural representations. The data preprocessing system receives selections of attributes or values based on these representations. The data preprocessing system generates recommendations of transformations based on the attributes or values selected. The data preprocessing system builds a transformation script based on the recommendations of the transformations. The transformation script can be used for preprocessing the dataset for analysis by a data analysis system.

Visual interactions for transforming datasets with nested data structures

Transforming datasets with nested data structures

A system determines samples of datasets that are typically processed by big data analysis systems. The samples are for use for development and testing of transformations for preprocessing the datasets in preparation for analysis by big data systems. The system receives one or more transform operations input datasets for the transform operations. The system determines samples associated with the transform operations. According to a sampling strategy, the system determines samples that return at least a threshold number of records in the result set obtained by applying a transformation. According to another sampling strategy, the system receives criteria describing the result of the transform operations and determines sample sets that generate result sets satisfying the criteria as a result of applying the transform operations.

Sampling for preprocessing big data based on features of transformation results

Transformation based sampling for preprocessing big data

Growing community of inventors

San Francisco, CA, United States of America

Edward Eli Marschner