The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Oct. 08, 2013
Filed:
Oct. 17, 2011
David Oleson, San Francisco, CA (US);
Alexander Sorokin, Foster City, CA (US);
Greg Laughlin, San Francisco, CA (US);
Vaughn Hester, San Francisco, CA (US);
John Le, San Francisco, CA (US);
Christopher R. Van Pelt, San Francisco, CA (US);
Lukas A. Biewald, San Francisco, CA (US);
David Oleson, San Francisco, CA (US);
Alexander Sorokin, Foster City, CA (US);
Greg Laughlin, San Francisco, CA (US);
Vaughn Hester, San Francisco, CA (US);
John Le, San Francisco, CA (US);
Christopher R. Van Pelt, San Francisco, CA (US);
Lukas A. Biewald, San Francisco, CA (US);
CrowdFlower, Inc., San Francisco, CA (US);
Abstract
Systems and methods for evaluating a worker in performing crowd sourced tasks and providing in-task training are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for selecting a job distributed through a job distribution platform for workers to work on, for use to generate a test task, the job being associated with a known correct result, associating a manipulated result, known to be an incorrect result for the job, with the job to generate the test task, and/or presenting the job with the manipulated result as the test task to a worker for evaluation of work quality of the worker. The job distribution platform crowd sources tasks online to workers to work on via their respective computing devices.