Intuit, Inc.

Amit Shriram Kalamkar

Vigith Maurice

Edward Kihyen Lee

Sean McCluskey

Juanlu Yu

Sriramu Singaram

Edward K Lee

Aram Martirosyan

Narender Kumar

Gary Danko

Aspects of the present disclosure relate to watermarks and watermarking techniques for data streaming pipelines. Time stamp and offset timeline data is shared by computing instances along the pipeline to enable improved watermarking of the data stream through the pipeline. The improved watermarks enable better determination of completeness for the data stream and improve materialization of the results. The watermarking techniques can include periodically publishing watermark data by processing units of a vertex, fetching a merged watermark for a vertex by a vertex, and/or watching a data storage for the watermark data for events. Consensus algorithms can be used to maintain consensus among vertices for the watermark data.

Offset-based watermarks for data stream processing

A method including receiving events from different data sources for a service automatically executing in an enterprise system. A first event is enriched by providing the first event with first metadata that associates the first event with a first application used by the service. The first event is assigned to a time slice associated with the first application. A second event is enriched in a similar manner. A correlation graph of nodes and edges is built using the enriched events, with nodes representing the events and edges indicating relationships between the edges. A third event indicating a fault in the first application associated with the first node is received. The source of the error for the third event is identified using the second updated correlation graph and the time slice. The source of error is then mitigated.

Enriched high fidelity metrics

A method implements a streaming machine learning platform. The method includes processing event data with a preprocessing application to generate model input data and cardinality data in response to receiving the event data from a streaming application. The method further includes forwarding, using the cardinality data, the model input data to a machine learning model. The method further includes processing the model input data with the machine learning model to generate model output data stored to an output record. The method further includes processing the model output data from the output record with a post processing application to generate post data stored to a post record. The method further includes generating notification data using the post data of the post record and transmitting a notification of the notification data.

Streaming machine learning platform

A system including a data repository storing metrics describing operational behavior of software programs executing in an enterprise system. The system also includes an application programming interface (API) gateway configured to receive the metrics. The system also includes an ingestion layer configured to ingest the metrics to form the ingested metrics. The system also includes a tumbling window processor configured to process the ingested metrics and the events into heat maps, sort the heat maps into the time slices, and populate the time slices with the ingested metrics.

A method may include receiving an event from an event source. The event may correspond to event data. The event source may be a container executing an image. The image may correspond to image metadata including attributes describing the image. The method may further include combining the event data with the image metadata to obtain enriched data, detecting, using the enriched data, a deviation from a policy, and in response to detecting the deviation from the policy, performing an action to enforce the policy.

Integrated event processing and policy enforcement

A method includes receiving first metrics describing first behaviors of applications having a fault, and second metrics describing second behaviors of an enterprise system in which the applications are executing. The first and second metrics are ingested. Ingesting includes assigning a first cardinality score to first metrics related to the fault. Ingesting also includes assigning a second, lower cardinality score to second metrics that are unrelated to the fault. Tumbling window processing is performed on the ingested metrics by sorting the first metrics and the second metrics into time slices. Each of the time slices includes a corresponding data structure for storing the data in the different time periods. Tumbling window processing is also performed on the ingested metrics by storing more data in the time slices for the first metrics having the first cardinality score relative to the second metrics having the second cardinality score.

A method for generating a software container includes receiving a software application and a containerization file. The method also includes building an image file using the containerization file, the image file containing the software application. The method also includes recording, in the image file, an image lineage. The method also includes performing a security scan of the image file to obtain a result, the security scan comprising checking the image file for inadequacies. The method also includes assigning, to the image file, a security level selected from among a plurality of different predetermined security levels. Assigning is based on a combination of the image lineage and the result of the security scan. The method also includes signing the image file with the security level to create a signed image file. The method also includes storing the signed image file as the software container.

Container packaging device

A method and system generates extended patterns from base patterns with an automatic pattern generation engine. The method and system tests the extended patterns with an automatic pattern testing engine. The patterns correspond to configurations for implementing cloud-based applications. The patterns are extendable to make additional extended patterns. Extended patterns carry the characteristics of the patterns from which they were extended. Updating a base pattern with new security measures causes a cascade effect that updates all extended patterns that descend from the base pattern.

Method and system for testing an extended pattern using an automatic pattern testing engine

A method and system provides automatic patterns for implementing cloud based applications. The automatic patterns are extendable to make additional extended patterns. Extended patterns carry the characteristics of the patterns from which they were extended. Updating a base pattern with new security measures causes a cascade effect that updates all extended patterns that descend from the base pattern.

Method and system for automatic patterns generation and testing

A method and system generates extended patterns from base patterns with an automatic pattern generation engine. The patterns correspond to configurations for implementing cloud-based applications. The patterns are extendable to make additional extended patterns. Extended patterns carry the characteristics of the patterns from which they were extended. Updating a base pattern with new security measures causes a cascade effect that updates all extended patterns that descend from the base pattern.

Method and system for extending a base pattern using an automatic pattern generation engine

A method and system generates extended patterns from base patterns and tests the extended patterns. The patterns correspond to configurations for implementing cloud-based applications. The patterns are extendable to make additional extended patterns. Extended patterns carry the characteristics of the patterns from which they were extended. Updating a base pattern with new security measures causes a cascade effect that updates all extended patterns that descend from the base pattern. The method and system automatically stacks and launches applications according to the extended patterns.

Growing community of inventors

Fremont, CA, United States of America

Amit Shriram Kalamkar