The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Nov. 05, 2019
Filed:
May. 18, 2016
International Business Machines Corporation, Armonk, NY (US);
International Business Machines Corporation, Armonk, NY (US);
Abstract
At a cache manager of a directed acyclic graph-based data analytic platform, from each of a plurality of monitor components on a plurality of worker nodes, statistics are obtained for a plurality of tasks, including which of the tasks have been processed and which are in a task queue. Each of the tasks has at least one associated distributed dataset. Each worker has a distributed dataset cache. A current stage directed acyclic graph is obtained from a directed acyclic graph scheduler component. For a given one of the tasks which has been processed, and for which it is determined that no other ones of the tasks depend on the at least one distributed dataset associated with the given one of the tasks, the distributed dataset is evicted from a corresponding one of the distributed dataset caches.