International Business Machines Corporation

Alexander Robert Wood

Doina Liliana Klinger

Chengxuan Xing

Tom Soal

Samuel S May

Thomas Soal

A method for authorizing a pull request from a managed cluster may include generating an encrypted pull secret for a managed cluster, assigning the generated encrypted pull secret to the managed cluster, determining, responsive to receiving a pull request from a managed cluster at the service provider where the pull request has an accompanying encrypted pull secret, whether the pull request was initiated by an intended managed cluster by decrypting the encrypted pull secret assigned to the managed cluster using a decryption key, and authorizing the pull request based on whether the decrypted pull secret is assigned to an intended managed cluster.

Data cluster management

An approach to implement an extract, transform and load system, a queue is provided for holding units of data between extraction and transformation. When units of data suffer a rate limit error in the load phase, they are requeued so they can be resubmitted for transformation. The contents of the queue are monitored and, if too many requeued units of data are detected in the queue, then this is taken as an indicator of an unacceptable number of rate limit errors and active pacing management is triggered. A retry schedule is defined for the requeued units of data. Extraction is temporarily halted to allow the requeued units of data to be retransformed without more units of data queuing up. Then, after the suspension is lifted, a pacing delay is inserted between subsequent extract events to avoid the same load phase bottleneck recurring.

Managing extract, transform and load systems

A method, system, and computer program product are configured to: receive, from a user device of a user, input indicating that a first extract, transform, and load (ETL) flow is incorrect and that a second ETL flow is correct; in response to receiving the input, determine whether a change made by the first ETL flow is reversible; in response to determining the change made by the first ETL flow is reversible, generate a corrective ETL flow that is configured to reverse the change made by the first ETL flow; and in response to determining the change made by the first ETL flow is not reversible, notify a user that the change made by the first ETL flow is not reversible, and inform the user which records have been changed such that they can do a manual correction.

Correcting errors of a running extract, transform, load (ETL) process

Concepts for sharing processing resource of a multi-tenant extract transform load, ETL, system are presented. In such concepts, a total workload of the multi-tenant ETL system is considered along with the queued workload of tenant in order control deliver of the queued workload to the system. Such control is undertaken, for example, by delaying the work of the tenant. Proposed embodiments therefore seek to devise a policy to achieve fairness amongst tenants.

Growing community of inventors

Romsey, United Kingdom

Alexander Robert Wood