Educational Testing Service

Xianyang Chen

Michael Flor

Beata Beigman Klebanov

Swapna Somasundaran

Chee Wee Leong

Chong Min Lee

Patrick D Houghton

Vinay K Basheerabad

Data is received that includes a passage of text. The passage of text can be tokenized so that features can be extracted from the resulting tokens. One or more machine learning models can detect one or more metaphors within the passage of text using the extracted features. The at least one machine learning model can be trained, for example, by interleaving data relating to metaphors with data relating to one or more auxiliary tasks associated with related figurative language constructs. Data can then be provided that identifies the detected metaphors. Related apparatus, systems, techniques and articles are also described.

Machine learning-based metaphor detection

Data is received that encapsulates a video of a subject performing a task. This video is used to generate a transcript using an automatic speech recognition (ASR) system. A plurality of text segments are generated from the transcript and then tokenized. A textual representation of each segment is extracted by a transformer model using the tokenized text segment (i.e., the tokens corresponding to the text segment). Thereafter, for each segment, a fused representation derived from the textual representations and corresponding visual and audio features from the video is generated. A sparse attention machine learning model then selects an optimal slice of the video based on the fused representations. The optimal slice can then be input into one or more machine learning models trained to characterize performance of the task by the subject.

NLP-guided video thin-slicing for automated scoring of non-cognitive, behavioral performance tasks

Quality of a narrative is characterized by receiving data that includes a narrative text. This narrative text is then tokenized and events are extracted from the tokenized words. The extraction can use, in parallel, two or more different extraction techniques. The extracted events are then extracted so that a waveform can be generated based on the aggregated extracted events that characterizes a plurality of emotional arcs within the narrative text. Subsequently, a plurality of waveform elements are extracted from the waveform. The narrative quality (or other quality) of the narrative text is then scored based on the extracted plurality of waveform elements and using a machine learning model trained to correlate emotional arc waveforms with narrative quality scores. Related apparatus, systems, techniques and articles are also described.

Machine learning-based automated narrative text scoring including emotion arc characterization

Growing community of inventors

Princeton, NJ, United States of America

Xianyang Chen