Phonetic similarity search for customizing automatic speech recognition

Abstract

Phonetic similarity search may be performed for performing custom automatic speech recognition. A ranked list of possible texts for speech in audio data generated by a general speech recognition machine learning model may be obtained. Unique tokens from different texts in the ranked list may be determined. Respective vectors of phonetic features for the unique tokens may be determined. A similarity search to generate a set of candidate entities using the respective vectors of phonetic features in a phonetic feature index generated for a custom set of entities to be included in a speech recognition. Similarity scores for the candidate entities paired with the tokens may be generated and then used to determine a candidate entity to replace a token in one of the texts to provide as a text of speech in the audio data.