International Business Machines Corporation

Ioannis Gkoufas

Stefano Braghin

Srikumar Venugopal

Christian Pinto

Spyridon Antonatos

Michele Gazzetti

Michael Johnston

Marco Simioni

Konstantinos Katrinis

Vasileios Vasileiadis

Valentina Rho

Pol Mac Aonghusa

Panagiotis Koutsovasilis

Archit Patke

A computer-implemented method, a computer program product, and a computer system for determining optimal data access for deep learning applications on a cluster. A server determines candidate cache locations for one or more compute nodes in the cluster. The server fetches a mini-batch of a dataset located at a remote storage service into the candidate cache locations. The server collects information about time periods of completing a job on the one or more nodes, where the job is executed against fetched mini-batch at the candidate cache locations and the mini-batch at the remote storage location. The server selects, from the candidate cache locations and the remote storage location, a cache location. The server fetches the data of the dataset from the remote storage service to the cache location, and the one or more nodes execute the job against fetched data of the dataset at the cache location.

Determining optimal data access for deep learning applications on a cluster

Systems and techniques that facilitate policy-driven views of datasets are provided. In various embodiments, a system can comprise a data component that can access a dataset. In various instances, the system can further comprise a view policy component that can respectively correlate a set of security credentials to a set of view instructions associated with the dataset. In various embodiments, the system can further comprise an input component that can receive as input a first security credential that is listed in the set of security credentials. In various aspects, the system can further comprise an output component that can identify a first view instruction that is listed in the set of view instructions associated with the dataset, wherein the first view instruction is respectively correlated to the first security credential. In various cases, the output component can generate as output a view of the dataset based on the first view instruction.

Policy-driven views of datasets

A computer implemented method for optimizing performance of workflow includes associating each of a plurality of workflow nodes in a workflow with a data cache and managing the data cache on a local storage device on one of one or more compute nodes. A scheduler can request execution of the tasks of a given one of the plurality of workflow nodes on one of the one of more compute nodes that hosts the data cache associated with the given one of the plurality of workflow nodes. Each of the plurality of workflow nodes is permitted to access a distributed filesystem that is visible to each of the plurality of compute nodes. The data cache stores data produced by the tasks of the given one of the plurality of workflow nodes.

Optimization of workflows with dynamic file caching

Embodiments of the present invention provide computer-implemented methods, computer program products, and systems. Embodiments of the present invention can be used to receive position information for one or more user devices and location information for an area. Embodiments of the present invention can predict one or more locations of the one or more user devices. Embodiments of the present invention can, in response to a request for navigation services, dynamically navigate a first user device of the one or more devices to a second user device of the one or more devices within the area.

Collaborative positioning navigation

Various embodiments are provided for preventing disclosure of confidential data in a computing environment are provided. Data may be inspected prior to publication to a communication channels. Selected portions of the data may be extracted. The selected portions of the data may be filtered according to degree of appropriateness defined in one or more publishing policies or rules prior to sending the filtered data to the communication channel.

Preventing leakage of selected information in public channels

Embodiments for space-efficient secondary indexing on distributed data stores in a networked computing environment by a processor. Replicas of corresponding master data at a file system level of a distributed file system (DFS) are sorted for creating secondary indexes of the replicas on different columns of a database table, wherein existing replication data is leveraged for the sorting.

Space-efficient secondary indexing on distributed data stores

Embodiments for performing self-contained, consistent data masking in a distributed computing environment by a processor. A data masking operation is performed on one or more datasets in one of a plurality of data formats such that a key of each value of each key-value pair representing a common set of columns or paths for the one or more datasets is masked.

Growing community of inventors

Dublin, Ireland

Ioannis Gkoufas