Figure Eight Technologies, Inc.

Crowdflower, Inc.

Christopher R Van Pelt

Lukas A Biewald

Ryan J Cox

Alexander Sorokin

John Le

David Oleson

Greg Laughlin

Brian Collin Hahn

Alex Sorokin

Vaughn Hester

Michael Juster

Systems and methods of adaptive workflow definition of crowd sourced tasks and quality control mechanisms for multiple business applications are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for generating and distributing tasks to workers to optimize product categorization in an online marketplace, generating and distributing tasks to workers for search engine optimization of a website, and/or generating and distributing tasks to workers for business data verification and enhancement. Results can be aggregated from multiple workers to enhance or improve site information, site organization, or other business information to improve site placement in search results and/or to enhance/improve user experience.

Adaptive workflow definition of crowd sourced tasks and quality control mechanisms for multiple business applications

Systems and methods of dynamic optimization for data quality control in crowd sourcing tasks to crowd labor are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for dynamically monitoring results received from workers for a task distributed for evaluation via a job distribution platform, incrementally assigning additional workers to the task using the results and continuously monitoring additional results to assign any additional workers if needed to meet a quality metric for the task.

Dynamic optimization for data quality control in crowd sourcing tasks to crowd labor

Systems and methods for using virtual currency to compensate workers in a crowd sourced task are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of determining target accuracy in completion of the task by the online workers, computing a number of results to be collected for a unit job of the task based on the target accuracy; and/or setting a wage amount that is offered to a worker for completing a unit job of the task based on the number of results. In response to determining that the worker has completed the unit job, the wage is provided to the online worker in a form of virtual currency.

Using virtual currency to compensate workers in a crowdsourced task

Systems and methods of crowd sourcing by distributing a task over a network to multiple workers for completion while providing quality control are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of identifying an attribute of the task, the task including multiple unit jobs, determining target accuracy in completion of the task by the multiple workers, computing a number of results to be collected for a unit job of the task based on the target accuracy, setting a wage amount that is offered to a worker for completing a unit job of the task based on the attribute and the target accuracy, and/or collecting and aggregating statistics of the workers completing the select unit jobs for quality control.

Distributing a task to multiple workers over a network for completion while providing quality control

Systems and methods of a job distribution platform for aggregating performance data in a worker profile for workers in performing crowd sourced tasks are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of generating and storing performance data when a worker performs one or more tasks distributed online to their respective computing devices by a job distribution platform which crowd sources tasks over a network to remote workers. The tasks can span current jobs and a history of previous jobs distributed to the worker and the job performance data for the worker is collected for current and previous jobs. New jobs can be assigned to a worker selected based on performance data of the worker.

Predicting future performance of multiple workers on crowdsourcing tasks and selecting repeated crowdsourcing workers

Systems and methods for evaluating a worker in performing crowd sourced tasks and providing in-task training are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for selecting a job distributed through a job distribution platform for workers to work on, for use to generate a test task, the job being associated with a known correct result, associating a manipulated result, known to be an incorrect result for the job, with the job to generate the test task, and/or presenting the job with the manipulated result as the test task to a worker for evaluation of work quality of the worker. The job distribution platform crowd sources tasks online to workers to work on via their respective computing devices.

Growing community of inventors

San Francisco, CA, United States of America

Christopher R Van Pelt