Amazon Technologies, Inc.

Canyon IP Holdings, LLC

Hugh Evan Secker-Walker

Baiyang Liu

Kenneth John Basye

Stan Weidner Salvador

Frederick Victor Weber

Mahesh Krishnamoorthy

Ariya Rastrow

Bjorn Hoffmeister

Tony David

Jeffrey Penrod Adams

Reinhard Kneser

Aaron Lee Mathers Challenner

Ryan Paul Thomas

Jeffrey C O'Neill

Alexander David Rosen

Karthik Ramakrishnan

Nikko Strom

Imre Attila Kiss

Naresh Narayanan

Alborz Geramifard

Nitin Sivakrishnan

Michael Maximilian Emanuel Bisani

Shengbin Yang

Jeffrey Cornelius O'NEILL

Features are disclosed for automatically identifying a speaker. Artifacts of automatic speech recognition ('ASR') and/or other automatically determined information may be processed against individual user profiles or models. Scores may be determined reflecting the likelihood that individual users made an utterance. The scores can be based on, e.g., individual components of Gaussian mixture models (“GMMs”) that score best for frames of audio data of an utterance. A user associated with the highest likelihood score for a particular utterance can be identified as the speaker of the utterance. Information regarding the identified user can be provided to components of a spoken language processing system, separate applications, etc.

Automatic speaker identification using speech recognition features

Features are disclosed for generating intent-specific results in an automatic speech recognition system. The results can be generated by utilizing a decoding graph containing tags that identify portions of the graph corresponding to a given intent. The tags can also identify high-information content slots and low-information carrier phrases for a given intent. The automatic speech recognition system may utilize these tags to provide a semantic representation based on a plurality of different tokens for the content slot portions and low information for the carrier portions. A user can be presented with a user interface containing top intent results with corresponding intent-specific top content slot values.

Intent-specific automatic speech recognition result generation

Power consumption for a computing device may be managed by one or more keywords. For example, if an audio input obtained by the computing device includes a keyword, a network interface module and/or an application processing module of the computing device may be activated. The audio input may then be transmitted via the network interface module to a remote computing device, such as a speech recognition server. Alternately, the computing device may be provided with a speech recognition engine configured to process the audio input for on-device speech recognition.

Speech recognition power management

Features are disclosed for automatically identifying a speaker. Artifacts of automatic speech recognition ('ASR') and/or other automatically determined information may be processed against individual user profiles or models. Scores may be determined reflecting the likelihood that individual users made an utterance. The scores can be based on, e.g., individual components of Gaussian mixture models ('GMMs') that score best for frames of audio data of an utterance. A user associated with the highest likelihood score for a particular utterance can be identified as the speaker of the utterance. Information regarding the identified user can be provided to components of a spoken language processing system, separate applications, etc.

Provided are systems and methods for receiving a plurality of item submissions from a plurality of mobile user devices (each item submission of the plurality of item submissions including: item identifier data indicative of an item; and item location data indicative of a location of the item), determining a determined location for the item (using the respective item location data for each of the plurality of item submissions), and storing the determined location for the item in an item location database. The determined location for the item is stored in association with an item identifier corresponding to the item, and the item location database stores determined locations for a plurality of items.

Systems and methods for locating items

A secure repository receives and stores user data, and shares the user data with trusted client devices. The user data may be shared individually or as part of bundled data relating to multiple users, but in either case, the secure repository associates specific data with specific users. This association is maintained by the trusted client devices, even after the data is altered by processing on the client device. If a user requests a purge of their data, the system deletes and/or disables that data on both the repository and the client devices, as well as deleting and/or disabling processed data derived from that user's data, unless a determination has been made that the processed data no longer contains confidential information.

Bounded access to critical data

Features are disclosed for managing the use of speech recognition models and data in automated speech recognition systems. Models and data may be retrieved asynchronously and used as they are received or after an utterance is initially processed with more general or different models. Once received, the models and statistics can be cached. Statistics needed to update models and data may also be retrieved asynchronously so that it may be used to update the models and data as it becomes available. The updated models and data may be immediately used to re-process an utterance, or saved for use in processing subsequently received utterances. User interactions with the automated speech recognition system may be tracked in order to predict when a user is likely to utilize the system. Models and data may be pre-cached based on such predictions.

Speech model retrieval in distributed speech recognition systems

Incremental speech recognition results are generated and used to determine a user's intent from an utterance. Utterance audio data may be partitioned into multiple portions, and incremental speech recognition results may be generated from one or more of the portions. A natural language understanding module or some other language processing module can generate semantic representations of the utterance from the incremental speech recognition results. Stability of the determined intent may be determined over the course of time, and actions may be taken in response to meeting certain stability thresholds.

Incremental utterance processing and semantic stability determination

A voice controlled assistant having a housing to hold one or more microphones, one or more speakers, and various computing components. The voice controlled assistant facilitates transactions and other functions primarily through verbal interactions with a user. In some situations, a transaction may require entry of a code, which the user may wish to enter in a non-verbal way. The voice controlled assistant is configured to analyze an audio signal to detect user interactions with the surface of the voice controlled assistant and to interpret the detected interactions as entry of the code.

Voice controlled assistant with non-verbal user input

An efficient audio streaming method and apparatus includes a client process implemented on a client or local device and a server process implemented on a remote server or server(s). The client process and server process each have speech recognition components and communicate over a network, and together efficiently manage the detection of speech in an audio signal streamed by the local device to the server for speech recognition and potentially further processing at the server. The client process monitors audio input and in a first detection stage, implements endpointing on the local device to determine when speech is detected. The client process may further determine if a 'wakeword' is detected, and then the client process opens a connection and begins streaming audio to the server process via the network. The server process receives the speech audio stream and monitors the audio, implementing endpointing in the server process, to determine when to tell the client process to close the connection and stop streaming audio. The client process continues streaming audio to the server until the server process determines disconnect criteria have been met and tells the client process to stop streaming audio.

Growing community of inventors

Newburyport, MA, United States of America

Hugh Evan Secker-Walker