On-line background noise adaptation of parallel model combination hmm with discriminative learning using weighted hmm for noisy speech recognition

Abstract

A system for adaptively generating a composite noisy speech model to process speech in, e.g., a nonstationary environment comprises a speech recognizer, a re-estimation circuit, a combiner circuit, a classifier circuit, and a discrimination circuit. In particular, the speech recognizer generates frames of current input utterances based on received speech data and determines which of the generated frames are aligned with noisy states to produce a current noise model. The re-estimation circuit re-estimates the produced current noise model by interpolating the number of frames in the current noise model with parameters from a previous noise model. The combiner circuit combines the parameters of the current noise model with model parameters of a corresponding current clean speech model to generate model parameters of a composite noisy speech model. The classifier circuit determines a discrimination function by generating a weighted PMC HMM model. The discrimination learning circuit determines a distance function by measuring the degree of mis-recognition based on the discrimination function, determines a loss function based on the distance function, which is approximately equal to the distance function, determines a risk function representing the mean value of the loss function, and generates a current discriminative noise model based in part on the risk function, such that the input utterances correspond more accurately with the predetermined model parameters of the composite noisy speech model.