Educational Testing Service

Xiaoming Xi

Klaus Zechner

Lei Chen

Su-Youn Yoon

Isaac I Bejar

Shasha Xie

Chaitanya Ramineni

Systems and methods are provided for scoring non-native speech. Two or more speech samples are received, where each of the samples are of speech spoken by a non-native speaker, and where each of the samples are spoken in response to distinct prompts. The two or more samples are concatenated to generate a concatenated response for the non-native speaker, where the concatenated response is based on the two or more speech samples that were elicited using the distinct prompts. A concatenated speech proficiency metric is computed based on the concatenated response, and the concatenated speech proficiency metric is provided to a scoring model, where the scoring model generates a speaking score based on the concatenated speech metric.

Computer-implemented systems and methods for scoring concatenated speech responses

Computer-implemented systems and methods are provided for assessing non-native spontaneous speech pronunciation. Speech recognition on digitized speech is performed using a non-native acoustic model trained with non-native speech to generate word hypotheses for the digitized speech. Time alignment is performed between the digitized speech and the word hypotheses using a reference acoustic model trained with native-quality speech. Statistics are calculated regarding individual words and phonemes in the word hypotheses based on the alignment. A plurality of features for use in assessing pronunciation of the speech are calculated based on the statistics, an assessment score is calculated based on one or more of the calculated features, and the assessment score is stored in a computer-readable memory.

Systems and methods for assessment of non-native spontaneous speech

Systems and methods are provided for scoring speech. A speech sample is received, where the speech sample is associated with a script. The speech sample is aligned with the script. An event recognition metric of the speech sample is extracted, and locations of prosodic events are detected in the speech sample based on the event recognition metric. The locations of the detected prosodic events are compared with locations of model prosodic events, where the locations of model prosodic events identify expected locations of prosodic events of a fluent, native speaker speaking the script. A prosodic event metric is calculated based on the comparison, and the speech sample is scored using a scoring model based upon the prosodic event metric.

Computer-implemented systems and methods for evaluating prosodic features of speech

A method and system for providing immediate diagnostic feedback on speech samples of non-native speakers are disclosed. A scoring model is generated based on speech features extracted from one or more training speech samples. An evaluation speech sample is received and speech features of the evaluation speech sample are determined. Based on the scoring model and the speech features, diagnostic feedback is provided to the speaker. In an alternate embodiment, speech features are extracted from an evaluation speech sample. The speech features are then compared with optimal values, ranges of values, or norms for those features. Based on the result of the comparison, diagnostic feedback is provided to the speaker.

Growing community of inventors

Pennington, NJ, United States of America

Xiaoming Xi