Splunk Inc.

Vmware, Inc.

Cisco Technology, Inc.

Steven Flanders

Mayank Agarwal

Gergely Danyi

Steven Karis

Eric Wohlstadter

Vardan Movsisyan

Maxime Petazzoni

Scott Stewart

Joseph Ari Ross

Chengyu Yang

Dmitrii Anoshin

Nicholas Kushmerick

Justin Smith

In order to extract more contextualized metrics associated with a particular service in a microservices-based application, a method of aggregating metrics comprises analyzing tags of spans for each trace and, based on a first predetermined set of rules, extracting one or more tags pre-selected by a user of the monitoring service. A pre-selected tag may appear in one or more spans associated with a particular service in a trace and may be extracted as a numeric metric. The method comprises computing a set of metrics for the particular service using the numeric metric extracted from the one or more spans of the trace. The method also comprises determining a set of aggregated metrics over the selected time duration for the particular service by aggregating the set of metrics over multiple traces.

Extracting contextualized metrics from spans in a microservices-based architecture

A method of tracking errors in a system comprising microservices comprises ingesting a plurality of spans generated by the microservices during a given duration of time. The method further comprises consolidating the plurality of spans associated with the given duration of time into a plurality of traces, wherein each trace comprises a subset of the plurality of spans that comprise a common trace identifier. For each trace, the method comprises: a) mapping a respective trace to one or more error stacks computed for the respective trace and to one or more attributes determined for the respective trace; and b) emitting each error stack computed from the respective trace with an associated pair of attributes. The method then comprises reducing duplicate pairs of error stack and associated attributes and maintaining a count for each pair of error stack and associated attributes.

In a microservices-based application, tracking errors by mapping traces to error stacks

A computer-implemented method for analyzing spans and traces associated with a microservices-based application executing in a distributed computing environment comprises aggregating a plurality of ingested spans associated with one or more applications executing in the distributed computing environment into a plurality of traces, wherein each of the plurality of ingested spans is associated with a plurality of tags. The method further comprises comparing durations of a set of related traces of the plurality of traces to determine patterns for the plurality of tags and generating a histogram that represents a distribution of the durations of the set of related traces. The method also comprises providing alerts for one or more tags from the plurality of tags associated with traces having a duration above a threshold based on the distribution of the durations.

Configuring alerts for tags associated with high-latency and error spans for instrumented software

A method of performing error analysis in a system comprising microservices comprises identifying a root cause error span from among a plurality of error spans for a trace, wherein an error span is a span that returns an error to a microservice that generates the span, and wherein a root cause error span is an error span associated with an error originating microservice. The method further comprises determining a call path associated with the root cause error span, where the call path comprises a chain of spans starting at the root cause error span, and where each subsequent span in the chain is a parent span of a prior span. Subsequently the method comprises mapping each span in the chain to a span error frame to create an error stack and rendering an image of the error stack.

Displaying error stacks in a graphical user interface (GUI) to track error propagation across microservices-based applications

A method of analyzing a performance of a microservices-based application comprises generating a plurality of traces from a plurality of spans associated with the microservices-based application. The method also comprises generating a plurality of data sets each associated with a respective analysis mode of a plurality of analysis modes using the plurality of traces, wherein each analysis mode extracts a different level of detail for analyzing the performance of the services in the application from the plurality of spans. Further, the method comprises selecting, based on a first user query, a first analysis mode from the plurality of analysis modes for generating a response to the first user query. The method also comprises accessing a data set of the plurality of data sets that is associated with the first analysis mode and generating the response to the first user query using the data set associated with the first analysis mode.

Multiple modes of storing and querying trace data in a microservices-based architecture

A method of rendering a graphical user interface (GUI) comprising an application topology graph for a microservice architecture comprises generating a plurality of traces from a first plurality of spans generated by instrumented services in the architecture and generating generate a second plurality of spans for uninstrumented services using information extracted from the first plurality of spans. The method further comprises grouping the second plurality of spans with the plurality of traces. Subsequently, the method comprises traversing the traces and collecting a plurality of span pairs from the plurality of traces, wherein each pair of the span pairs is associated with a call between two services. The method also comprises aggregating information across the plurality of span pairs to reduce duplicative information associated with multiple occurrences of a same span pair from the plurality of span pairs. Finally, the method comprises rendering the application topology graph using the aggregated information.

Application topology graph for representing uninstrumented objects in a microservices-based architecture

Application topology graph for representing instrumented and uninstrumented objects in a microservices-based architecture

Methods and systems automatically adjusting resources and monitoring configurations of objects of a distributed computing system in response to changes to application programs. Methods search event messages for information indicating a change in execution of an object. The information is used to determine resource allocation rules of infrastructure resources by and a monitoring configuration for the object. Expected impacts on the infrastructure resource are determined from the rules. When an expected impact is greater than an associated impact threshold, use of the infrastructure resources may be adjusted to accommodate the changes. The adjustments include scaling up or down the infrastructure resources. When the object is a virtual object, the virtual object may be migrated from one server computer to another server computer within the distributed computer system. The monitoring configuration is used to adjust tools that monitor the objects of the distributed computing system.

Methods and systems to adjust resources and monitoring configuration of objects in a distributed computing system

Analyzing tags associated with high-latency and error spans for instrumented software

Tracking error propagation across microservices-based applications

The present disclosure is related to devices, systems, and methods for persistent alert notes. An example method can include receiving an alert message via a log management server, wherein the alert message indicates a current alert instance particular to a class of alerts, retrieving, in response to receiving the alert message, a note stored in association with the class of alerts via the log management server, wherein the note includes resolution information corresponding to a previous alert instance particular to the class of alerts, and providing the retrieved note via a user interface of the log management server.

Persistent alert notes

In a microservices-based application, mapping distributed error stacks across multiple dimensions

Multiple modes of data collection and analysis in a microservices-based architecture

Graphical user interface (GUI) for representing instrumented and uninstrumented objects in a microservices-based architecture

A method of performing error analysis in a system comprising microservices comprises identifying a root cause error span from among a plurality of error spans for a trace associated with a user-request, wherein an error span is a span that returns an error to a microservice initiating a call resulting in the span, and wherein a root cause error span is an error span associated with an error originating microservice. The method further comprises determining a call path associated with the root cause error span, where the call path comprises a chain of spans starting at the root cause error span, and where each subsequent span in the chain is a parent span of a prior span. Subsequently the method comprises mapping each span in the chain to a span error frame to create an error stack and rendering an image of the error stack.

Growing community of inventors

Nashua, NH, United States of America

Steven Flanders