The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 02, 2022
Filed:
Jan. 06, 2011
Joshua M Attenberg, Roxbury, CT (US);
Foster J Provost, New York, NY (US);
Joshua M Attenberg, Roxbury, CT (US);
Foster J Provost, New York, NY (US);
Integral Ad Science, Inc., New York, NY (US);
Abstract
Methods, systems, and media for providing direct and hybrid data acquisition approaches are provided. In accordance with some embodiments of the disclosed subject matter, a method of data acquisition for construction of classification models that incorporates multiple human reviewing resources is provided, the method comprising: receiving a cost structure for constructing a classification model using a data set; instructing human reviewing resources to search through the data set and select instances of a class that satisfy a criterion, providing the human reviewing resources with a definition of the class; training the classification model with the instances from the human reviewing resources; determining when an expected gain for performing additional searches by the human reviewing resources as a function of the cost structure is lower than a given threshold; and, instructing the human reviewing resources searching through the set to label one or more examples from the data set.