Training data collection system, similarity score calculation system, document retrieval system, and non-transitory computer readable recording medium storing training data collection program

Abstract

A vector generation unit derives a reference feature vector and a document feature vector. A feature quantity extraction unit performs a dimensionality reduction process on the reference feature vector and the document feature vector so as to set a dimensional value as a first feature quantity and derives a cosine similarity between the reference feature vector and the document feature vector as a second feature quantity. A grid division unit classifies documents into first partial regions obtained by dividing a feature quantity space of the first feature quantity, and classifies the documents into second partial regions obtained by dividing a range of the second feature quantity. A training data extraction unit selects, for each combination of a first partial region and a second partial region, a document classified in both the partial regions and sets documents selected with respect to all combinations as training data.