Microsoft Technology Licensing, LLC

Google Inc.

Julian James Odell

Matthew Nirvan Sharifi

Dominik Roblek

David Petrou

Robert L Chambers

Jorge Pereira

Cong Li

Gabriel Taubman

Blaise Hilary Aguera-Arcas

Brandon Charles Barbello

Thomas Weedon Hume

Michael D Plumpe

Christopher Thornton

Oliver Scholz

Beat Gfeller

Jan Heinrich Althaus

Jon Hamaker

Kevin I Kilgour

Marvin Karl Ritter

James David Lyon

Katsiaryna Naliuka

Bongshin Lee

Bo Thiesson

Daniel Ramage

Tim Paek

Wei Huang

Tim Phillip Wantland

Gary Voronel

Mihajlo Velimirović

Rob Chambers

Christopher Dac Le

Kaikai Wang

Seungyeon Kim

Shahid Durrani

Onur Domanic

Iulia Turc

Alejandro Acero

Dong Yu

Larry Paul Heck

Lisa Joy Stifelman

Yun-Cheng Ju

Milind V Mahajan

Xiaodong He

Nikko Strom

Kunal Mukerjee

William Folwell Barton

Li Jiang

Stephen Frederick Potter

Madhusudan Chinthakunta

Daniel R Dole

Wei Zhang

David Gareth Ollason

Keith Coleman Herold

Jonathan E Hamaker

William H Rockenbeck

Peter K L Mau

Matthew Sharifi

Karen Kaushansky

Jim Chou

Larry Coryell

Michelle S Spina

Olilver Scholz

Sandeep Manocha

Systems and methods are provided for a personalized entity repository. For example, a computing device comprises a personalized entity repository having fixed sets of entities from an entity repository stored at a server, a processor, and memory storing instructions that cause the computing device to identify fixed sets of entities that are relevant to a user based on context associated with the computing device, rank the fixed sets by relevancy, and update the personalized entity repository using selected sets determined based on the rank and on set usage parameters applicable to the user. In another example, a method includes generating fixed sets of entities from an entity repository, including location-based sets and topic-based sets, and providing a subset of the fixed sets to a client, the client requesting the subset based on the client's location and on items identified in content generated for display on the client.

Personalized entity repository

The present disclosure is directed to input suggestion. In particular, the methods and systems of the present disclosure can: receive, from a first application executed by one or more computing devices, data indicating information that has been presented by and/or input into the first application; generate, based at least in part on the received data, one or more suggested candidate inputs for a second application executed by the computing device(s); provide, in association with the second application, an interface comprising one or more options to select at least one suggested candidate input of the suggested candidate input(s); and responsive to receiving data indicating a selection of a particular suggested candidate input of the suggested candidate input(s) via the interface, communicate, to the second application, data indicating the particular suggested candidate input.

Methods and systems for input suggestion

In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products. A computing device stores reference song characterization data and receives digital audio data. The computing device determines whether the digital audio data represents music and then performs a different process to recognize that the digital audio data represents a particular reference song. The computing device then outputs an indication of the particular reference song.

Determining that audio includes music and then identifying the music as a particular song

In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products for indicating a reference song. A computing device stores reference song characterization data that identifies a plurality of audio characteristics for each reference song in a plurality of reference songs. The computing device receives digital audio data that represents audio recorded by a microphone, converts the digital audio data from time-domain format into frequency-domain format, and uses the digital audio data in the frequency-domain format in a music-characterization process. In response to determining that characterization values for the digital audio data are most relevant to characterization values for a particular reference song, the computing device outputs an indication of the particular reference song.

Identifying music as a particular song

Individuals may utilize devices to engage in conversations about topics respectively associated with a location (e.g., restaurants where the individuals may meet for dinner). Often, the individual momentarily withdraws from the conversation in order to issue commands to the device to retrieve and present such information, and may miss parts of the conversation while interacting with the device. Additionally, the individual often explores such topics individually on a device and conveys such information to the other individuals through messages, which is inefficient and error-prone. Presented herein are techniques enabling devices to facilitate conversations by monitoring the conversation for references, by one individual to another (rather than as a command to the device), to a topic associated with a location. In the absence of a command from an individual, the device may automatically present a map alongside a conversation interface showing the location(s) of the topic(s) referenced in the conversation.

Facilitating conversations with automated location mapping

A local feedback mechanism for customizing training models based on user data and directed user feedback is provided in speech recognition applications. The feedback data is filtered at different levels to address privacy concerns for local storage and for submittal to a system developer for enhancement of generic training models.

Local and remote aggregation of feedback data for speech recognition

Real-time query expansion (RTQE) is a process of supplementing an original query with addition terms or expansion choices that are ranked according to some figure of merit and presented while users are still formulating their queries. As disclosed herein, phrases may be presented and one or more terms of a focused-on phrase may be pinned (as desirable to the user). Subsequent lists may be presented as a function of pinned terms and/or user input. In one embodiment, a placeholder may be substituted for one or more pinned terms if less than some predetermined threshold of phrases is able to be presented based upon the pinned terms and/or user input, and another list of phrases may be presented as a function of a query using fewer than all the pinned terms. The placeholder may allow out-of-index phrases to be formed, for example, based upon two or more phrases and/or terms input by the user.

Phrase generation using part(s) of a suggested phrase

Techniques to provide automatic speech recognition at a local device are described. An apparatus may include an audio input to receive audio data indicating a task. The apparatus may further include a local recognizer component to receive the audio data, to pass the audio data to a remote recognizer while receiving the audio data, and to recognize speech from the audio data. The apparatus may further include a federation component operative to receive one or more recognition results from the local recognizer and/or the remote recognizer, and to federate a plurality of recognition results to produce a most likely result. The apparatus may further include an application to perform the task indicated by the most likely result. Other embodiments are described and claimed.

Combination and federation of local and remote speech recognition

Semantically distinct items are extracted from a single utterance by repeatedly recognizing the same utterance using constraints provided by semantic items already recognized. User feedback for selection or correction of partially recognized utterance may be used in a hierarchical, multi-modal, or single step manner. An accuracy of recognition is preserved while the less structured and more natural single utterance recognition form is allowed to be used.

Recognizing multiple semantic items from single utterance

Growing community of inventors

Kirkland, WA, United States of America

Julian James Odell