Amazon Technologies, Inc.

Jeff Bradley Beal

Sumedha Arvind Kshirsagar

Ajay Gopalakrishnan

Nishant Kumar

Kevin Robert Charter

Brandon William Porter

Jeromey Russell Goetz

David Robert Thomas

Alan Stuart Robbins

Joseph L Ellsworth

Vikas Jain

Shishir Sridhar Bharathi

Grant Alexander Macdonald McAlister

John Daniel Thimsen

Grant A M McAlister

Robert David Owen

A speech recognition platform configured to receive an audio signal that includes speech from a user and perform automatic speech recognition (ASR) on the audio signal to identify ASR results. The platform may identify: (i) a domain of a voice command within the speech based on the ASR results and based on context information associated with the speech or the user, and (ii) an intent of the voice command. In response to identifying the intent, the platform may perform multiple actions corresponding to this intent. The platform may select a target action to perform, and may engage in a back-and-forth dialog to obtain information for completing the target action. The action may include streaming audio to the device, setting a reminder for the user, purchasing an item on behalf of the user, making a reservation for the user or launching an application for the user.

Outcome-oriented dialogs on a speech recognition platform

Features are disclosed for performing functions in response to user requests. Natural Language Understanding ('NLU') processing may be performed to generate command data that represents a subject of an utterance. The command data may be sent to an application that causes presentation of first output content in a first modality at a first time in response to receiving the command data, and generates second output content in a second modality different from the first modality, wherein the second output content is associated with the first output content. The second output content may be presented in the second modality at a second time subsequent to the first time.

Dialog management with multiple modalities

Various embodiments of a system and method for tracking service requests are described. Embodiments may include call tree generation logic configured to receive multiple request identifiers associated with a respective one of multiple service requests. Each given request identifier may include an origin identifier, a depth value, and a request stack comprising one or more interaction identifiers. The call tree generation logic may also be configured to, based on multiple request identifiers that each include an origin identifier associated with a particular root request, generating a data structure that specifies a hierarchy of services called to fulfill that particular root request. Based on one or more of the interaction identifiers and one or more of the depth values, the generated data structure may specify for each given service of the hierarchy: a parent service that called the given service, and one or more child services called by the given service.

System and method for tracking service requests

System and method for tracking service results

Features are disclosed for performing functions in response to user requests based on contextual data regarding prior user requests. Users may engage in conversations with a computing device in order to initiate some function or obtain some information. A dialog manager may manage the conversations and store contextual data regarding one or more of the conversations. Processing and responding to subsequent conversations may benefit from the previously stored contextual data by, e.g., reducing the amount of information that a user must provide if the user has already provided the information in the context of a prior conversation. Additional information associated with performing functions responsive to user requests may be shared among applications, further improving efficiency and enhancing the user experience.

Dialog management with multiple applications

Dialog management context sharing

Natural language controlled devices may be implemented in an environment where the devices are configured to operate with multiple different users. The techniques described herein implement security requirements for a device configured to operate in an environment where the multiple different users may request functionality. The security requirements may be implemented based on the whether the functionality requested is personal and/or secured.

Dialogue-driven user security levels

Growing community of inventors

Edgewood, WA, United States of America

Jeff Bradley Beal