Microsoft Technology Licensing, LLC

Amazon Technologies, Inc.

Richard Leigh Mains

Jae Pum Park

Sean Anthony Rooney

Jonathan Reed Harris

Timothy Thomas Gray

Ashok Kuppusamy

Jaclyn Carley Knapp

Jesse Daniel Eskes Rusak

Chad Steven Estes

Michael Francis Palermiti, Ii

Jayant Sivarama Krishnamurthy

Harris Syed

Allison Anne O'Mahony

David Ernesto Heekin Burkett

Diego Hernan Carlomagno

Brian Peter Kralyevich

Talon Edward Ireland

Jose Miguel Rady Allende

Christopher Andrew Evans

Nino Yuniardi

Chad Gibson

Bryan Todd Agnetta

Marc Anthony Salazar

Sara Tahir

Andrew Paul McGovern

Marcus E Pina

Aaron Michael Donsbach

Viktoriya Taranov

Jason Glenn Silvis

Jason Phillip Kriese

Steven Michael Sommer

Catherine Ann Hendricks

Tudor Buzasu Klein

Sergiy Gavrylenko

Charles Cummins

Michael James Hone

Anastasia Paushkina

Ramez Naam

Suzan Marashi

Mira Lane

Jamie Paul Buckley

Vibhunandan Gavini

Blair Harold Beebe

Zachary Gutt

Eric Michael Schurman

Angela Lam

Thomas Irvine Nelson

Kwan Ting Lee

Shilpan Bhagat

Andrew Paul Mcgovern

Garret Martin Miller Graaf

Evan Nicklas Wu Malahy

Kemp Crockett Peterson

Anthony Tran

Grant Hinkson

David Adrian Jara

Santhosh Kumar Paraliyil Krishnankutty

Joseph Robert Buchta

Venkata Nagesh Babu Balivada

Gregory Carlo Formichelli

Chad C Gibson

Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. Such heavy integration also allows particular embodiments to support multi-modal input from a user for a single conversational interaction. In this way, client application user interface interactions, such as clicks, touch gestures, or text inputs are executed alternative or in addition to the voice utterances.

Voice assistant-enabled client application with user view context and multi-modal input support

Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to both perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. For example, some embodiments can automatically and intelligently cause a switch to a page the user needs and automatically and intelligently cause a population of particular fields of the page the user needs based on a user view context and the voice utterance.

Voice assistant-enabled client application with user view context

Persistent media playback techniques are described. In an implementation, a media player is served via a network for display by a browser of a device. Web pages are served via the network for display by the browser of the device. Each of the web pages is configured for integration with the media player so that the media player is persistently displayed by the browser during navigation among the web pages. The media player may be configured to play media files providing a variety of different media types. The media player may also provide contextual suggestions of media.

Persistent media playback

Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Mobile device interfaces

Mobile device applications

A system that generates a personalized content grouped by type and ordered by relevancy. The system determines relevant data for individual feature groups, determines first feature groups that have relevant data to display and displays a page of content for each of the first feature groups. For example, a first page of content may indicate a clock, temperature, weather forecast or timer, a second page of content may correspond to communications and indicate a recent message, a third page of content may correspond to a calendar and may indicate an upcoming event, a fourth page of content may correspond to shipping notifications and may indicate an upcoming shipment, a fifth page of content may correspond to contacts and may indicate an available favorite contact and a sixth page of content may correspond to trending news. The device may generate synthesized speech corresponding to the display of content.

Organization of personalized content

Systems and methods for displaying an audio indicator including a main portion having a width proportional to a volume of a particular phoneme of an utterance is described herein. In some embodiments, audio data representing an utterance may be received at a speech-processing system from a user device. The speech-processing system may determine a maximum volume amplitude for the utterance, and using the maximum volume amplitude, may determine a normalized amplitude value between 0 and 1 associated with a volume that phoneme's of an utterance are spoken. The speech-processing system may then map the normalized amplitude value(s) to widths for a main portion of an audio indicator, where larger normalized amplitude values may correspond to smaller main portion widths. Display data representing a graphical user interface may then be generated and sent to the user device, where the graphical user interface includes the audio indicator having its main portion of a particular width representative of a volume of each phoneme from the utterance.

Speech-based audio indicators

A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies or other such elements, to indicate objects that are recognized or identified. As objects are recognized, fireflies perform one or more specified actions to indicate recognition. A ribbon or other user-selectable icon is displayed indicates a specific action that the device can perform with respect to the respective object. As additional objects are recognized, additional ribbons are created and older ribbons can be moved off screen and stored for subsequent retrieval or search. The fireflies disperse when the objects are no longer represented in captured sensor data, and can be animated to move towards representations of new objects as features of those objects are identified as potential object features, in order to communicate a level of recognition for a current scene or environment.

Recognition interfaces for computing devices

Search results and associated search-result details are provided in response to user queries. Embodiments include identifying a number of search-result details for different indexed search results, identifying one or more detail-attributes for each search-result detail, and identifying one or more user-attributes for a particular user. These search results, associated search-result details, and associated detail-attributes may be stored in a database. Upon receiving a search query from the user, search results may be generated. Search-result details specific to each search result and specific to the end-user may also be generated by identifying the detail-attributes associated with each search-result detail and the user-attributes associated with the end-user. These search results may then be presented to the end-user. Upon receiving an indication of interest in a particular search result, the search result details may then be presented to the end user.

On-demand search result details

Growing community of inventors

Seattle, WA, United States of America

Richard Leigh Mains