Educational Testing Service

Eugene Tsuprun

Keelan Evanini

Vikram Ramanarayanan

David Suendermann-Oeft

Yao Qian

Patrick Lange

Alexei V Ivanov

Rutuja Ubale

Hillary Molloy

Systems and methods are provided for conducting a simulated conversation with a language learner include determining a first dialog state of the simulated conversation. First audio data corresponding to simulated speech based on the dialog state is transmitted. Second audio data corresponding to a variable length utterance spoken in response to the simulated speech is received. A fixed dimension vector is generated based on the variable length utterance. A semantic label is predicted for the variable-length utterance based on the fixed dimension vector. A second dialog state of the simulated conversation is determined based on the semantic label, and third audio data corresponding to simulated speech is transmitted based on the second dialog state.

Exploring ASR-free end-to-end modeling to improve spoken language understanding in a cloud-based dialog system

Systems and methods are provided providing a spoken dialog system. Output is provided from a spoken dialog system that determines audio responses to a person based on recognized speech content from the person during a conversation between the person and the spoken dialog system. Video data associated with the person interacting with the spoken dialog system is received. A video engagement metric is derived from the video data, where the video engagement metric indicates a level of the person's engagement with the spoken dialog system.

Computer-implemented systems and methods for evaluating speech dialog system engagement via video

Growing community of inventors

Hillsborough, NJ, United States of America

Eugene Tsuprun