The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jul. 09, 2013
Filed:
Apr. 02, 2012
Joel Arditi, Haifa, IL;
David Harold Berk, Haifa, IL;
Dagan Gilat, Haifa, IL;
Sergey Krutyolkin, Haifa, IL;
Ariel Landau, Haifa, IL;
Uri Shani, Haifa, IL;
Joel Arditi, Haifa, IL;
David Harold Berk, Haifa, IL;
Dagan Gilat, Haifa, IL;
Sergey Krutyolkin, Haifa, IL;
Ariel Landau, Haifa, IL;
Uri Shani, Haifa, IL;
International Business Machines Corporation, Armonk, NY (US);
Abstract
A data processing method is provided. The method comprises collecting a stream of data records received from one or more data sources connected in a communications network; dividing the stream of data records into sets of data records for parallel processing by a plurality of concurrently running tasks, wherein a first task loads a persistent index associated with a first set of data records into memory to generate an in-memory version of the first persistent index for the first set of data records; and identifying duplicate and non-duplicate data records in the first set of data records, based on searching the in-memory version of the first persistent index.