Cloudera, Inc.

Philip Zeyliger

Vikas Singh

Chang She

Sudhanshu Arora

Marcelo Masiero Vanzin

Patrick David Hunt

Philip Lee Langdale

Aaron Newton

Techniques are disclosed for inferring design-time information based on run-time artifacts generated by services operating in a distributed computing cluster. In an embodiment, a metadata system extracts metadata including run-time artifacts generated by services in a distributed computing cluster while processing a workflow including multiple jobs. The extracted metadata is processed to identify entities and entity relationships which can then be used to generate lineage information. Using the lineage information, the metadata system can infer design-time information associated with the workflow. The inferred design-time information can then be utilized to, for example, recreate the workflow, recreate previous versions of the workflow, optimize the workflow, etc.

Design-time information based on run-time artifacts in a distributed computing cluster

Information based on run-time artifacts in a distributed computing cluster

A sysSQL technology for querying operating system states of multiple hosts in a cluster using a Structured Query Language (SQL) query is disclosed. An administrator of a cluster can use a graphical or text-based user interface to submit an SQL query to determine the operating system states of multiple hosts in parallel. The technology parses the SQL query to determine the datasets needed to execute the SQL query and aggregates those datasets from the multiple hosts. The technology then creates a temporary database to execute the SQL query and provides the results from the SQL query for display on the user interface.

Querying operating system state on multiple machines declaratively

Systems and methods for centralized configuration of a distributed computing cluster are disclosed. One embodiment of the disclosed technology provides a user environment that facilitates a selection of a service to be run on hosts in the distributed computing cluster and configuration of the service or hosts in the distributed computer cluster. The disclosed technology can further configure each of the hosts in the distributed computing cluster to run the service based on a set of configuration settings.

Centralized configuration of a distributed computing cluster

Systems and methods for centralized configuration and monitoring of a distributed computing cluster are disclosed. One embodiment of the disclose technology enables deployment and central operation a complete Hadoop stack. The application automates the installation process and reduces deployment time from weeks to minutes. One embodiment further provides a cluster-wide, real time view of the services running and the status of the host machines in a cluster via a single, central place to enact configuration changes across the computing cluster which further incorporates reporting and diagnostic tools to optimize cluster performance and utilization.

Centralized configuration and monitoring of a distributed computing cluster

Systems and methods for user interface implementation for partial display update are disclosed. One embodiment of the method, which may be embodied on a system includes, in a response received from a web server, identifying, for a web page, a set of elements able to he updated partially as displayed without refreshing the user interface in its entirety, detecting, in the response, updated elements in the set of elements that have been updated from a value displayed in the user interface, and/or partially updating the user interface to reflect changes to the updated elements in the web page without refreshing other portions of the user interface.

Growing community of inventors

San Francisco, CA, United States of America

Philip Zeyliger