Amazon Technologies, Inc.

Santosh Kalki

Timothy Andrew Rath

Srinivasan Sundar Raghavan

Mukul Vijay Karnik

Swaminathan Sivasubramanian

Amol Devgan

Anurag Windlass Gupta

Jared Scott Lundell

Ajay Gopalakrishnan

John Alfred Payne

Sudipto Guha

Karthik Tamilmani

Yung Haw Wang

Mohan Varthakavi

Yoav Srebrnik

Adam Stephen Duncan

Jenny Bandy Freshwater

Akshay Satish

Jose Kunnackal John

Anurang Windlass Gupta

A platform for data analytics may be provided in a hosted environment on a multi-tenant system. The platform provider may also provide transactional processing services. Data obtained from processing the transactional services may be stored in an n-dimensional cube with which analytics may be performed. A dimension and hierarchy model may be identified based on correlations between hierarchy dimensions and levels in a dataset, or in schema and queries related to the dataset. Correlations may be further based on data received from a data stream. Priority for calculating a hierarchy may be based on data received from a data stream.

Automated hierarchy detection for cloud-based analytics

A data analysis system determines characteristics of a data set such as statistical measures, analytical insights, data trends, or relationships with other data sets. The system determines a level of importance for each determined characteristic using metadata associated with the data set, and, in some cases, user preferences provided by the user. Such metadata may include descriptive names, data types, and data characteristics of the data set and of data elements within the data set.

Data reporting system and method

Techniques for seasonality-based anomaly detection and forecast are described. For example, a method of receiving a request to generate forecast for received time series data; performing a seasonality-based anomaly detection and forecast for the received time series data based upon the received request, the seasonality-based anomaly detection and forecasting to utilize a second data structure that reflect anomalies found in a first data structure on the input from the received time series data; and providing a result of the performed seasonality-based anomaly detection and forecast is described.

Anomaly detection with missing values and forecasting data streams

A probabilistic counting structure such as a hyperloglog may be formed during a table scan for each of a selected set of columns. The columns may be selected based on an initial estimate of relatedness, which may be based on data types of the respective columns. An estimated cardinality of an intersection or union of columns may be formed based on an intersection of the probabilistic data structures. A join path may be determined based on the estimated cardinality of an intersection or union of the columns.

Efficient determination of join paths via cardinality estimation

A hosted analytics system may be integrated with transactional data systems and additional data sources such real-time systems and log files. A data processing pipeline may transform data on arrival for incorporation into an n-dimensional cube. Correlation between patterns of events in transactional data may be identified. Upon arrival, new data may be transformed and incorporated into the n-dimensional cube. Similarity between the new data and a previously identified correlation may be determined and flagged.

Dynamic detection of data correlations based on realtime data

An online analytical processing system may comprise an n-dimensional cube partitioned into slices, in which each slice may represent data points at the intersections of fixed and variable dimensions. Computation of data points within a slice may be deferred. A dependency graph may be initially constructed, in which the dependency graph is utilized in a subsequent computation. Calculation of data points may be prioritized based on information indicative of a chance that the data points will be accessed.

Data interest estimation for n-dimensional cube computations

Real-time hosted system analytics

A corpus of information describing queries used to access a transactional data store may be used to identify analytical relationships that are not explicitly defined in a schema or supplied by a user. Join relationships may be identified based on field coincidence in elements of queries in the corpus. Join relationships may be indicative of dimensions and attributes of a dimension. Hierarchy levels for a dimension may be identified based on factors including data type, reference in an aggregating clause, and reference in a grouping clause.

Identifying join relationships based on transactional access patterns

An online analytical processing system may comprise an n-dimensional cube structured using slice-based partitioning in which each slice comprises one or more hierarchies of data points. A region of a hierarchy may be classified according to computational demands associated with the region. A scaling or replication mechanism may be applied to the region based on the computational demands associated with that region.

Dynamic n-dimensional cubes for hosted analytics

An analytics module may be embedded into an application developed, published, or used by an entity in addition to the owner of the data under analysis. An access token may be submitted by the analytics module to a provider of hosted services. The access token may correspond to an n-dimensional cube containing data at a level of granularity permitted to the application. The access token may incorporate additional policies controlling access to the corresponding n-dimensional cube.

Embeddable cloud analytics

Data may be stored using hybrid multidimensional and column-centric storage techniques. A hierarchy of regions of a multidimensional space may be maintained on one or more storage devices. Range information for the hierarchy may be maintained in a column-centric storage. Leaf nodes of the hierarchy may comprise tuple data stored in a column-centric storage. Tuples may be located by identifying candidate regions encompassing the tuple and scanning column-centric stores at the leaf level. Region splitting may be deferred to favor column-centric search characteristics.

Hybrid spatial and column-oriented multidimensional storage structure

A multi-tenant system for providing hosted analytic services may be dynamically configured in response to a request from a user. A request for analytic services may comprise an indication of at least one data source to be incorporated into an n-dimensional cube. A data source connector and transformation pipeline may transform data received from the data source to a format compatible with a dimension and hierarchy model of the n-dimensional cube.

Cloud analytics marketplace

A request that includes a syntax tree is received. A query plan that comprising one or more queries using storage metadata and one or more data attributes obtained from the syntax tree is generated. Individual ones of the one or more queries are used to retrieve at least one of the one or more data attributes from the at least two datastores. The generating of the query plan is generated by modifying individual ones of the one or more queries to access a datastore of the at least two datastores having a lower data retrieval latency. The one or more queries of the query plan are executed to generate the report, the report including data resulting from the executing of the one or more queries.

Growing community of inventors

Seattle, WA, United States of America

Santosh Kalki