International Business Machines Corporation

Mathew Richard Odden

Lance Bragstad

James E Carey

Bin Cao

Michael J Branson

Martin L Schmatz

Vaijayanthimala K Anand

Patricia Maria Sagmeister

Michael John Fork

Navaneeth Rameshan

Adam D Reznechek

Bruno Henriques

Methods and systems for unified HSM and key management services are disclosed. According to certain embodiments, an encryption service request is issued by a client instance to a key management service (KMS) logic in a KMS cloud instance. The KMS logic parses the request to verify authorization for the request, identify the instance ID, and provide additional information to the request needed by hardware security management (HSM) middleware and hardware. A router receives the request from the KMS logic and routes the request to a service based on the instance ID, that transfers the request to HSM middleware. The HSM middleware parses HSM type from the request, translates the request to HSM vendor-specific instructions and routes the translated request to an HSM. The HSM according to certain embodiments is in a cloud computing environment separate from the KMS cloud instance, and in some embodiments the HSM is on-prem at a physical client site.

Unified HSM and key management service

Methods, apparatuses, and computer program products for visualizing migration of a resource of a distributed computing environment are provided. Embodiments include displaying, within a graphical user interface (GUI), one or more graphical resource representations. Each graphical resource representation represents a resource of a distributed computing environment. Each graphical resource representation is displayed in a particular location within the GUI according to a location of the resource within the distributed computing environment. Embodiments also include displaying, within the GUI, a first graphical migration representation. The first graphical migration representation represents a first transfer operation of a first resource of the distributed computing environment. Embodiments also include updating based on a progress of the first transfer operation, within the GUI at least one of: the first graphical migration representation and a location of at least one of the one or more graphical resource representations.

Visualizing migration of a resource of a distributed computing environment

Performance of parallel portions of a streaming application implemented in multiple virtual machines (VMs) is monitored and logged. When there is a need to replicate operators in an existing virtual machine to a new virtual machine, the logged performance data is used to determine a desired configuration for the new virtual machine based on a past implementation of the existing virtual machine.

Replicating a virtual machine implementing parallel operators in a streaming application based on performance

Performance thresholds are defined for operators in a flow graph for a streaming application. A streams manager deploys the flow graph to one or more virtual machines (VMs). The performance of each portion of the flow graph on each VM is monitored. A VM is selected. When the performance of the portion of the flow graph in the selected VM does not satisfy the defined performance threshold(s), a determination is made regarding whether the portion of the flow graph is underperforming or overperforming. When the portion of the flow graph is underperforming, the portion of the flow graph is split into multiple portions that are implemented on multiple VMs. When the portion of the flow graph is overperforming, a determination is made of whether a neighbor VM is also overperforming. When a neighbor VM is also overperforming, the two VMs may be coalesced into a single VM.

Allocating operations of a streaming application to virtual machines based on monitored performance

Allocating operators of a streaming application to virtual machines based on monitored performance

A streams manager monitors performance of parallel portions of a streaming application implemented in multiple virtual machines (VMs). When the performance provided by the multiple VMs is no longer needed, one or more of the VMs can be torn down. The performance of the VMs is monitored. When the least performing VM can be torn down, it is torn down. When the least performing VM cannot be torn down, information regarding a better performing VM is gathered, and it is determined whether the least performing VM can be made more similar to the better performing VM. When the least performing VM can be made more similar to the better performing VM, the least performing VM is changed to improve its performance, and the better performing VM is torn down.

Tearing down virtual machines implementing parallel operators in a streaming application based on performance

A streams manager monitors operator performance of a streaming application to determine when the performance of an operator needs to be improved or optimized. The streams manager in conjunction with a cloud manager automatically determines one or more preferred virtual machines in a cloud with a specified streams infrastructure that best meet the needs of the underperforming operator or application component based on physical location attributes of the preferred virtual machines. The cloud manager determines the physical location attributes of the candidate virtual machines. The streams manager or the cloud manager can then determine a preferred virtual machine of the candidates to deploy the operator based on the physical location attributes. The streams manager then modifies the flow graph so one or more operators of the streaming application are deployed to a preferred virtual machine determined according to the physical location attributes of the preferred virtual machine.

Deploying operators of a streaming application based on physical location attributes of a virtual machine

A resource utilization mechanism (RUM) preemptively extracts data from long latency storage in a cloud computing environment to economically and quickly provide data that is infrequently accessed by customers. The RUM identifies periods of low resource utilization where capacity can be efficiently utilized, identifies data to be retrieved, and retrieves the data from long latency storage to make it available to the customer. The RUM may notify a customer that the data is available and allow the customer to accept terms of use for the data or opt out of using the data.

Preemptive extraction of data from long latency storage in a cloud computing environment

A streams manager monitors performance of a streaming application, and when the performance needs to be improved, the streams manager automatically requests virtual machines from a cloud manager. The cloud manager provisions one or more virtual machines in a cloud with the specified streams infrastructure and streams application components. The streams manager then modifies the flow graph so one or more portions of the streaming application are hosted by the virtual machines in the cloud. When performance of the streaming application indicates a virtual machine is no longer needed, the virtual machine is maintained and placed in a ready state so it can be quickly used as needed in the future without the overhead of deploying a new virtual machine.

Maintaining virtual machines for cloud-based operators in a streaming application in a ready state

A streams manager monitors performance of a streaming application, and when the performance needs to be improved, the streams manager requests a cloud manager provision one or more VMs on a server that has a specified hardware type, and optionally has specified available hardware capacity. In response, the cloud manager determines which available servers have the specified hardware type, and when available hardware capacity is specified, further determines which of the available servers with the specified hardware type have the specified available capacity. When there are multiple servers that satisfy the request from the streams manager, the cloud manager determines from historical performance logs for the servers which is preferred. The cloud manager then provisions the requested VM(s) on the specified hardware type and returns the requested VM(s) to the streams manager. The streams manager then deploys a portion of the streaming application to the VM(s).

Growing community of inventors

Rochester, MN, United States of America

Mathew Richard Odden