Crowdflower, Inc.

Vaughn Hester

Lukas A Biewald

Christopher R Van Pelt

David Oleson

Alexander Sorokin

Greg Laughlin

John Le

Systems and methods for evaluating a worker in performing crowd sourced tasks and providing in-task training are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for selecting a job distributed through a job distribution platform for workers to work on, for use to generate a test task, the job being associated with a known correct result, associating a manipulated result, known to be an incorrect result for the job, with the job to generate the test task, and/or presenting the job with the manipulated result as the test task to a worker for evaluation of work quality of the worker. The job distribution platform crowd sources tasks online to workers to work on via their respective computing devices.

Growing community of inventors

San Francisco, CA, United States of America

Vaughn Hester