Ai-assisted human data augmentation and continuous training for machine learning models

Abstract

A method is provided for training at least one classifier model used by an artificial intelligence (AI) system to recognize each of a set of objects and to assign each of the set of objects to a class. The method includes training the at least one classifier model on a training dataset, thereby producing at least one trained classifier model; using the at least one trained classifier model to detect and classify each member of a set of objects, thereby generating a set of inferences, wherein each inference includes (a) a cropped image of a classified object, (b) the classified object's inferred class, and (c) a confidence score associated with the inferred classification; examining the set of inferences with a machine implemented audit trigger, wherein the audit trigger identifies a subset of the set of inferences whose members have (i) a confidence score that falls below a predetermined threshold value, or (ii) a missing classification; and if the identified subset has at least one member, subjecting the identified subset to a human audit, thereby yielding a corrected set of observations, wherein, for each member of the corrected set of observations, the inferred class of the corresponding member of the set of inferences is replaced with a corrected class. The corrected set of observations is then added to a training dataset and used to improve the future accuracy of the classifier model.