Soundhound, Inc.

Broadcom Corporation

Soundhound Ai Ip, LLC

Apple Inc.

Christopher S Wilson

Keyvan Mohajer

Bernard Mont-Reynaud

Stephen Olivier Lemay

Christopher Patrick Foss

Viresh Rustagi

Imran A Chaudhri

Alan C Dye

Eric Lance Wilson

Gary Ian Butcher

Kevin Will Chen

Lawrence Yuan Yang

Jonathan R Dascola

Giancarlo Yerkes

Lee S Broughton

Nathan De Vries

Robert MacRAE

Kheng Khov

Christopher Boross

Ian Graves

Regina Collecchia

Support for natural language expressions is provided by the use of semantic grammars that describe the structure of expressions in that grammar and that construct the meaning of a corresponding natural language expression. A semantic grammar extension mechanism is provided, which allows one semantic grammar to be used in the place of another semantic grammar. This enriches the expressivity of semantic grammars in a simple, natural, and decoupled manner.

Using semantic grammar extensibility for collective artificial intelligence

The present disclosure generally relates to viewing and updating application views. A device receives a user input, the input, when received initiating display of a plurality of application views of a set of application views. The device, in response to receiving the user input, displays the plurality of application views of the set of application views, wherein the set of application views includes preselected application views and an adaptive view that corresponds to a most recently opened application that is not one of the preselected application views.

Displaying and updating a set of application views

The present invention extends to methods, systems, and computer program products for interpreting queries according to preferences. Multi-domain natural language understanding systems can support a variety of different types of clients. Queries can be received and interpreted across one or more domains. Preferred query interpretations can be identified and query responses provided based on any of: domain preferences, preferences indicated by an identifier, or (e.g., weighted) scores exceeding a threshold.

Interpreting queries according to preferences

A method is described that includes processing text and speech from an input utterance using local overrides of default dictionary pronunciations. Applying this method, a word-level grammar used to process the tokens specifies at least one local word phonetic variant that applies within a specific production rule and, within a local context of the specific production rule, the local word phonetic variant overrides one or more default dictionary phonetic versions of the word. This method can be applied to parsing utterances where the pronunciation of some words depends on their syntactic or semantic context.

Using phonetic variants in a local context to improve natural language understanding

A client device receives a user request (e.g., in natural language form) to execute a command of an application. The client device delegates interpretation of the request to a response-processing server. Using domain knowledge previously provided by a developer of the application, the response-processing server determines the various possible responses that client devices could make in response to the request based on circumstances such as the capabilities of the client devices and the state of the application data. The response-processing server accordingly generates a response package that describes a number of different conditional responses that client devices could have to the request and provides the response package to the client device. The client device selects the appropriate response from the response package based on the circumstances as determined by the client device, executes the command (if possible), and provides the user with some representation of the response.

Conditional responses to application commands in a client-server system

A domain-independent framework parses and interprets compound natural language queries in the context of a conversation between a human and an agent. Generic grammar rules and corresponding semantics support the understanding of compound queries in the conversation context. The sub-queries themselves are from one or more domains, and they are parsed and interpreted by a pre-existing grammar, covering one or more pre-existing domains. The pre-existing grammar, extended by the generic rules, recognizes all compound queries based on any queries recognized by the pre-existing grammar. Use of the disclosed framework requires little or no change in the domain-specific NLU handling code. The framework defines a generic approach to propagating context data between sub-queries of a compound query. The framework can be further extended to propagate intra-query context data in, out and across query components. Complex query results, and other data such as accounting data, can also be propagated simultaneously with dialog context data in a consolidated intra-query context data structure.

Framework for understanding complex natural language queries in a dialog context

The present invention extends to methods, systems, and computer program products for interpreting expressions having potentially ambiguous meanings in different domains. Multi-domain natural language understanding systems can support a variety of different types of clients. Expressions can be interpreted across multiple domains. Weights can be assigned to domains. Weights can be client specific or expression specific so that a chosen interpretation is more likely correct for the type of client or for its context. Stored weight sets can be chosen according to identifying information carried as metadata with expressions or weight sets carried directly as metadata. Domains can additionally or alternatively be ranked in ordered lists or comparative domain pairs of to favor some domains over others as appropriate for client type or client context.

Interpreting expressions having potentially ambiguous meanings in different domains

A query-processing server that interprets natural language expressions supports the extension of a first semantic grammar (for a particular type of expression), which is declared extensible, by a second semantic grammar (for another type of expression). When an extension is requested, the query-processing server checks that the two semantic grammars have compatible semantic types. The developers need not have any knowledge of each other, or about their respective grammars. Performing an extension may be done by yet another party, such as the query-processing server, or another server, independently of all previous parties. The use of semantic grammar extensions provides a way to expand the coverage and functionality of natural language interpretation in a simple and flexible manner, so that new forms of expression may be supported, and seamlessly combined with pre-existing interpretations. Finally, in some implementations, this is done without loss of efficiency.

Semantic grammar extensibility within a software development framework

A command-processing server provides natural language processing services to applications. The command-processing server stores a set of code blocks, each code block being able to interpret a set of corresponding natural language expressions. The command-processing server accepts natural language expressions and identifies the code blocks that are capable of interpreting those expressions by attempting to parse the natural language expressions using the code blocks. The command-processing server then provides a list of the identified code blocks to the developers, who can then incorporate the code blocks into their applications.

Identification of code for parsing given expressions

A command-processing server provides natural language services to applications. More specifically, the command-processing server receives natural language inputs from users for use in applications such as virtual assistants. Some user inputs create user-defined rules that consist of trigger conditions and of corresponding actions that are executed when the triggers fire. The command-processing server stores the rules received from a user in association with the specific user. The command-processing server also identifies rules that can be generalized across users and promoted into generic rules applicable to many or all users. The generic rules may or may not have an associated context constraining their application.

User-defined extensions of the command input recognized by a virtual assistant

The present disclosure relates to electronic message user interfaces. A device, including a display, a touch-sensitive surface, and a rotatable input mechanism, is described in relation to accessing, composing, and manipulating electronic messages. In some examples, a user can provide input through the rotatable input mechanism to access a landing screen of an electronic messages application. The landing screen concurrently displays an affordance for accessing an electronic messages inbox and an affordance for accessing an interface for composing electronic message.

Electronic message user interface

A dialog with a conversational virtual assistant includes a sequence of user queries and systems responses. Queries are received and interpreted by a natural language understanding system. Dialog context information gathered from user queries and system responses is stored in a layered context data structure. Incomplete queries, which do not have sufficient information to result in an actionable interpretation, become actionable with use of context data. The system recognizes the need to access context data, and retrieves from context layers information required to transform the query into an executable one. The system may then act on the query and provide an appropriate response to the user. Context data buffers forget information, perhaps selectively, with the passage of time, and after a sufficient number and type of intervening queries.

System and methods for a virtual assistant to manage and use context in a natural language dialog

Methods and systems for processing video data are disclosed herein and may comprise receiving within a single mobile multimedia processor chip integrated within a mobile device, a secure key from an off-chip device integrated within the mobile device. The secure key may be decrypted within the single mobile multimedia processor chip, utilizing an on-chip key. The decrypted secure key may be stored within the single mobile multimedia processor chip. The received encrypted data may be decrypted within the single mobile multimedia processor chip, using the stored, decrypted secure key. The on-chip key may be stored within a one-time programmable (OTP) memory in the single mobile multimedia processor chip. The stored on-chip key may be retrieved from the OTP memory for the decrypting. The stored decrypted received secure key may be encrypted utilizing the on-chip key stored within the single mobile multimedia processor chip.

Secure conditional access and digital rights management in a multimedia processor

Herein described is a method and system for providing shared access to data residing within a data pool of a data storage device. Aspects of the invention incorporate the use of one or more mechanisms by which access to the data occurs. The one or more mechanisms may be enabled or disabled by way of one or more selections that are made using a user interface. In a representative embodiment, the user interface may comprise a web browser. The method may involve assigning one or more values to one or more variables and subsequently executing a software program. The software program invokes one or more share access mechanisms when the one or more values are equal to one or more enabling values. The system may comprise a memory that is used to store the software program and a processor that is used to execute the software program.

Growing community of inventors

Santa Clara, CA, United States of America

Christopher S Wilson