Computer-aided assignment of ratings to digital samples of a manufactured web product

Abstract

A computerized rating tool is described that assists a user in efficiently and consistently assigning expert ratings (i.e., labels) to a large collection of training images representing samples of a given product. The rating tool provides mechanisms for visualizing the training images in an intuitive and configurable fashion, including clustering and ordering the training images. In some embodiments, the rating tool provides an easy-to-use interface for exploring multiple types of defects represented in the data and efficiently assigning expert ratings. In other embodiments, the computer automatically assigns ratings (i.e., labels) to the individual clusters containing the large collection of digital images representing the samples. In addition, the computerized tool has capabilities ideal for labeling very large datasets, including the ability to automatically identify and select a most relevant subset of the images for a defect and to automatically propagate labels from this subset to the remaining images without requiring further user interaction.