Amazon Technologies, Inc.

Charles Conroy Moore

Ramakanthachary S Gottumukkala

Shaun M Vickers

Vaidyanathan Puthucode Krishnamoorthy

Nalledath P Vinodkrishnan

Ankit Agrawal

Oleg Rokhlenko

Sethuraman Ramachandran

Swayam Bhardwaj

Giovanni Clemente

Julia Reinspach

Costantino Vlachos

Guy Michaeli

Joseph Spencer King

Andrew Olcott

Eric Allen Menninga

Andrew Scott Craft

Wainwright Gregory Siady Yu

Craig Reeves Brookes

Brandon LaBranche Watson

A request including audio data is received from a voice-enabled device. A string of phonemes present in the utterance is determined through speech recognition. At a later time, a subsequent user input corresponding to the request may be received, in which the user input is associated with one or more text keywords. The subsequent user input may be obtained in response to an active request. Alternatively, feedback may not be actively elicited, but rather collected passively. However it is obtained, the one or more keywords associated with the subsequent user input may be associated with the string of phonemes to indicate that the user is saying or mean those words when they product that string of phonemes. A user-specific speech recognition key for the user account is then updated to associate the string of phonemes with these words. A general speech recognition model can also be trained using the association.

Speech recognition through disambiguation feedback

In various embodiments, a voice command is associated with a plurality of processing steps to be performed. The plurality of processing steps may include analysis of audio data using automatic speech recognition, generating and selecting a search query from the utterance text, and conducting a search of database of items using a search query. The plurality of processing steps may include additional or different steps, depending on the type of the request. In performing one or more of these processing steps, an error or ambiguity may be detected. An error or ambiguity may either halt the processing step or create more than one path of actions. A model may be used to determine if and how to request additional user input to attempt to resolve the error or ambiguity. The voice-enabled device or a second client device is then causing to output a request for the additional user input.

Triggering voice control disambiguation

Some implementations include identifying conflicts between multiple layers of supplementary content associated with a digital work (e.g., an electronic book). For individual conflicts between layers of supplementary content at one or more locations within the digital work, conflicts between layers may be resolved in favor of a higher priority layer. Upon resolution of the conflict, information associated with the higher priority layer for supplementing content at a particular location in the digital work may be determined. A visual identifier of the higher priority layer may be displayed along with content associated with the digital work at the particular location.

Supplementary content layers

Growing community of inventors

Newcastle, WA, United States of America

Charles Conroy Moore