Method and system for selecting label from plurality of labels for task in crowd-sourced environment

Abstract

There is disclosed a method system for selecting a label for a task, the method comprising: receiving a plurality of labels, each of the label included within the plurality of labels being indicative of a given assessor's perceived preference of a first object of over a second object; analyzing the comparison task to determine a set of latent biasing features; executing a MLA configured to generating a respective latent score parameter for the first object and the second object, the respective latent score parameter indicative of a probable offset between the given assessor's perceived preference and an unbiased preference parameter of the first object over the second object; generating a predicted bias degree parameter for the given assessor; generating the unbiased preference parameter; using, by the server, the unbiased preference parameter as the label for the comparison task for the given assessor.