Asapp, Inc.

Tao Ma

Kyu Jeong Han

Michael Griffiths

Yi Yang

Hugh Nicholas Perkins

Daniel Povey

Madison Chandler Riley

Theodore David Burke

Connor Daniel McNabb

A communications session with a user may be automated using a language model. The language model may be instructed to select a next action to be performed where the next action may include transmitting a responsive communication to the user or performing an API call. The prompt used to query the language model may include one or more of the following: a representation of text of the communications session, a list of available API calls, instructions to select a next action, a representation of API calls performed, or a representation of API call responses received. The language model may be sequentially queried to continue the communications session by transmitting responsive communications or performing API calls. In some implementations, a prompt template may be used to generate the prompt and a prompt template may be selected using text of the communications session.

Prompting language models to select API calls

Audio signals of speech may be processed using an acoustic model. An acoustic model may be implemented with multiple streams of processing where different streams perform processing using different dilation rates. For example, a first stream may process features of the audio signal with one or more convolutional neural network layers having a first dilation rate, and a second stream may process features of the audio signal with one or more convolutional neural network layers having a second dilation rate. Each stream may compute a stream vector, and the stream vectors may be combined to a vector of speech unit scores, where the vector of speech unit scores provides information about the acoustic content of the audio signal. The vector of speech unit scores may be used for any appropriate application of speech, such as automatic speech recognition.

Multistream acoustic models with dilations

The present disclosure relates to a system, method, and computer program for creating a complete transcription of an audio recording from separately transcribed redacted and unredacted words. The system receives an original audio recording and redacts a plurality of words from the original audio recording to obtain a modified audio recording. The modified audio recording is outputted to a first transcription service. Audio clips of the redacted words from the original audio recording are extracted using word-level timestamps for the redacted words. The extracted audio clips are outputted to a second transcription service. The system receives a transcription of the modified audio recording from the first transcription service and transcriptions of the extracted audio clips from the second transcription service. The transcriptions of the extracted audio clips are combined with the transcription of the modified audio recording to obtain a complete transcription of the original audio recording using word-level timestamps.

System, method, and computer program for creating a complete transcription of an audio recording from separately transcribed redacted and unredacted words

Growing community of inventors

Mountain View, CA, United States of America

Tao Ma