Microsoft Technology Licensing, LLC

Tanvi Surti

Sean O Lyndersay

Chee Chen Tong

William Duncan Lewis

Xuedong D Huang

Israel Hilerio

Arul A Menezes

Olivier Nano

Ivo José Garcia Dos Santos

John Hazen

Christian Wendt

Michael J Patten

Vishwac Sena Kannan

Kenneth S Reneris

Charles Morris

Derek Martin Liddell

Cheng-Yi Yen

Michael Z Stephens

Dieter Rindle

Eka Tjung

Vishal Chandulal Chowdhary

Michael Patten

Sean Lyndersay

Systems and methods may be used to provide transcription and translation services. A method may include initializing a plurality of user devices with respective language output selections in a translation group by receiving a shared identifier from the plurality of user devices and transcribing the audio stream to transcribed text. The method may include translating the transcribed text to one or more of the respective language output selections when an original language of the transcribed text differs from the one or more of the respective language output selections. The method may include sending, a user device in the translation group, the transcribed text including translated text in a language corresponding to the respective language output selection for the user device. In an example, the method may include customizing the transcription or the translation, such as to a particular topic, location, user, or the like.

Customized transcribed conversations

A digital assistant includes an extensibility client that interfaces with application extensions that are built by third-party developers so that various aspects of application user experiences, content, or features may be integrated into the digital assistant and rendered as native digital assistant experiences. Application extensions can use a variety of services provided from cloud-based and/or local sources such as language/vocabulary, user preferences, and context services that add intelligence and contextual relevance while enabling the extensions to plug in and operate seamlessly within the digital assistant context. Application extensions may also access and utilize general digital assistant functions, data structures, and libraries exposed by the services and implement application domain-specific context and behaviors using the programming features captured in the extension. Such extensibility to third party applications can broaden the scope of the database of information that the digital assistant may use to answer questions and perform actions for the user.

Digital assistant extensibility to third party applications

Customized multi-device translated conversations

Customized multi-device translated and transcribed conversations

Various embodiments provide a frequent sites module which is designed to generate frequent sites for a user that include websites that are relevant to the user based on browsing patterns of the user. In one or more embodiments, the frequent sites are generated from user-engagement data that indicates engagement by the user with websites identified in the user's browsing history. A web platform, e.g., a web browser, can display the frequent sites for the user in a frequent sites user interface container to enable the user to efficiently navigate to the websites that are relevant to the user by selection of websites from the frequent sites user interface container. Various embodiments describe other aspects of frequent sites based on browsing patterns, including multiple-device frequent sites, device-specific frequent sites, domain-specific frequent sites, URL-specific frequent sites, decaying of frequent sites, recent frequent sites, and contextual frequent sites.

Frequent sites based on browsing patterns

A user context generator determines one or both of a location of a user and contextual information for the user. The contextual information is indicative of content of interest to the user. A custom content generator engine generates customized translated content for the user. Generating the customized translated content includes selecting, from translated content stored in a database, based on the one or both of the determined location of the user and the determined contextual information for the user, translated content to be presented to the user. The customized translated content includes a set of phrases in a source language and corresponding translations of phrases, in the set of phrases, from the source language to a target language. The selected translated content is displayed to the user, such that the user is provided with translated content of interest to the user.

Customized and contextual translated content for travelers

Techniques for extension interaction with applications are described. Generally, an extension represents functionality for extending, modifying, customizing, and/or supplementing native functionality of an application. Techniques discussed herein provide a common extension platform that enables an extension to interact with multiple different applications utilizing components of the platform. The common extension platform, for instance, exposes a set of common extension application programming interfaces (APIs) that provide a common interaction surface between extensions and applications.

Extension configuration and interaction

Extension interaction with applications

A system running on a mobile device such as a smartphone is configured to expose a user interface (UI) to enable a user to specify web pages that can be pinned to a start screen of the device. Once pinned, the user may launch a web page by voice command from any location on the UI or from within any experience that is currently being supported on the device. Thus, the user can be on a call with a friend talking about a new video game and then use a voice command to launch a web browser application on the mobile device that navigates to a pinned web page having information about the game's release date. Web pages can be readily pinned and unpinned from the start screen through the UI. When a web page is unpinned from the start screen, the system disables voice web navigation for it.

Client-side personal voice web navigation

Platform for extension interaction with applications

Growing community of inventors

Seattle, WA, United States of America

Tanvi Surti