Microsoft Technology Licensing, LLC

Haim Somech

Ido Priness

Dikla Dotan-Cohen

Adi L Miller

Shira Weinberg

Hadas Bitran

Assaf Avihoo

Oded Nahir

Michael Sterenberg

Hen Fitoussi

Colleen Elizabeth Hamilton

Uri Barash

Scott Vernon Fynn

Robert J Howard, Iii

Oded Vainas

Marc Eliot Davis

Kfir Karmon

Ho John Lee

Ido Cohn

Jeffrey D Friedberg

Gal Lavee

Limor Lahiani

Lilach Perry

Shai Ifrach

Moti Gindi

Michal Yarom Zarfati

Itamar Barkai

Adi Gerzi

Faith Y Xu

Omri Gutman

Alona Kushnirsky

Anat Inon

Eyal Badash

Michal Bloch Ron

Amitay Dror

Allen G Jones

Systems and methods for surfacing natural language queries from one or more transcripts. An example method may include converting received audio to text, through automated speech recognition, to form a transcript of the audio, wherein the transcript includes text of the audio and identifications of speakers associated with portions of the text corresponding to utterances from the respective speakers; generating input signals based on at least the transcript; executing at least one of one or more heuristics or a trained machine-learning (ML) model, using the generated input signals as an input, to generate at least one of a suggested natural language query for searching the transcript or a key moment within the received audio; and causing at least one of the suggested natural language query or the key moment to be surfaced on one or more remote devices.

Suggested queries for transcript search

Technology is disclosed for programmatically determining, for a segment of a meeting recording, a user-specific adaptive playback speed, and generating a time-stretched segment playable at the adaptive playback speed. The adaptive playback speed is faster or slower than a default playback speed of the meeting recording. To determine the adaptive playback speed, this disclosure provides technologies to determine a playback data feature based on user-meeting data. The adaptive playback is generated based on the playback data feature. The segment is time-stretched to the adaptive playback speed to generate an updated meeting recording including the segment that is time-stretched and playable at the adaptive playback speed. In this manner, an updated meeting recording, specific to a user, and playable at an adaptive playback speed based on user-meeting data may reduce bandwidth associated with user's manually editing videos or rewinding playback, while improving user experience.

Personalized adaptive meeting playback

In some implementations, a method includes extracting completion criteria of an action item and parameters of the completion criteria from a message portion of a user message between users. In response to determining, from sensor data provided by one or more sensors associated with a user, the user practices a routine; a routine-related aspect is generated from a user routine model of the user for the routine. In is inferred at least one of the extracted completion criteria of the action item is unsatisfied based on the extracted parameters and the identified routine-related aspect. Based on the inferring, a notification is provided to at least one user associated with the action item.

Notifications of action items in messages

Intelligent agents (IA) for automatically generating responses to content within a communication session (CS) are disclosed. An IA is trained to target the responses to a user and the user's context within the CS. An IA receives CS content that includes natural language expressions encoding users' conversations and determines content features based on natural language models. The content features indicate intended semantics of the expressions. The IA identifies likely-relevant content to the targeted user, to generate a response for. Identifying such content includes determining a relevance of the content based on content features, a context of the CS, a user-interest model, and a content-relevance model. Identifying the likely-relevant content to respond to is based on the determined relevance of the content and relevance thresholds. Various responses to the identified portions of the content are automatically generated and provided based on a natural language response-generation model targeted to the user.

Virtual assistant for generating personalized responses within a communication session

Technology is disclosed for improving user privacy and providing user control over user-activity data collected from personal computing devices (i.e., user devices). User devices may be configured to operate in a private mode that enables a user to control, for example, which aspects of user-activity data are provided to applications and services running on their user device; to obscure or modify aspects of user-activity data so that certain applications and services, which may require this information to operate, may still function, but that the obscured information provided to these applications and services preserves user privacy or no longer may be used to identify the user; or to remove evidence of user-activity data created, monitored, reported, or otherwise collected by or on the user device while the user is operating their user device in the private mode setting.

Privacy control operation modes

Methods for providing enhanced services to users participating in communication sessions (CS), via a virtual assistant, are disclosed. One method receives content that is exchanged by users participating in the CS. The content includes natural language expressions that encode a conversation carried out by users. The method determines content features based on natural language models. The content features indicate intended semantics of the natural language expressions. The method determines a relevance of the content and identifies portions of the content that are likely relevant to the user. Determining the relevance is based on the content features, a context of the CS, a user-interest model, and a content-relevance model of the natural language models. Identifying the likely relevant content is based on the determined relevance of the content and a relevance threshold. A summary of the CS is automatically generated from summarized versions of the likely relevant portions of the content.

Virtual assistant providing enhanced communication session services

Techniques of streaming data processing for hybrid online meetings are disclosed herein. In one example, a method includes receiving, at the remote server, a video stream captured by a camera in the conference room. The video stream captures images of multiple local participants of an online meeting. The method also includes determining identities of the captured images of the multiple local participants in the received video stream using meeting information of the online meeting and generating a set of individual video streams each corresponding to one of the multiple local participants. The set of individual video streams can then be transmitted to the second computing device corresponding to a remote participant of the online meeting as if the multiple local participants are virtually joining the online meeting.

Streaming data processing for hybrid online meetings

In some implementations, a method includes extracting message attributes of an email associated with a user from the email. User interaction data is identified that is generated by the user in association with display of the email based on sensor data from one or more sensors. It is determined that the user interaction data corresponds to a routine of the user based on a routine-related aspect generated from a user routine model representing the routine. A time to present a notification of the email is determined based on the routine. The notification is provided to the user on a user device based on the determined time to present the notification.

Notifications based on user interactions with emails

Systems, methods, and computer-readable storage media are provided for sharing user-information with bots. An automated task to be performed on behalf of a user is determined from at least one user message provided to a user interface of a first bot. A second bot is determined that is capable of performing the automated task on behalf of the user. User information of the user to provide to the second bot for the performing of the automated task is determined. Content of the user information is based on a trust level of the second bot and service parameters for completing the automated task. The first bot provides the determined user information to the second bot using one or more network communications.

Sharing user information with and between bots

Aspects of the technology described herein provide a personalized computing experience for a user based on a user-visit-characterized venue profile. In particular, user visits to a venue are determined. For those visits, user characteristics and/or visit characteristics are determined. User similarities and visit features similarities may be determined and associated with the venue to form the user-visit-characterized venue profile. The user-visit-characterized venue profile may be provided to an application or service such as a personal assistant service associated with the user, or may be provided as an API to facilitate consumption of the user-visit-characterized venue profile by an application or service.

Characterizing a place by features of a user visit

Aspects of the technology described herein improve the clarity of information provided in automatically generated notifications, such as reminders, tasks, alerts or other messages or communications provided to a user. The clarity may be improved through augmentations that provide additional information or specificity to the user. For example, instead of providing a notification reminding the user, 'remember to send the slides before the meeting,' the user may be provided with a notification reminding the user 'remember to send the updated sales presentation before the executive committee meeting on Tuesday. The augmentation may take several forms including substituting one word in the notification with another more specific word, adding additional content such as a word or phrase to the notification without altering the existing content, and/or by rephrasing the content for grammatical correctness and/or clarity.

Augmentation of notification details

Systems, methods, and computer-readable storage media are provided for automating personalized out-of-the-box and ongoing in-application settings. A triggering event is detected for an exchange of information between an information service and one or more application or service. A trust level and domain of information of the one or more application or service is determined. Based on the trust level and domain of information, information to be shared with the one or more application or service is identified and the identified information is shared. The information to be shared can be all of the requested information, some of the requested information, or none of the requested information.

Automated personalized out-of-the-box and ongoing in-application settings

Computerized systems for synchronizing multiple calendars are provided. User activity is monitored via sensors and user devices associated with the user. Monitoring user activity includes detecting calendar activity associated with a set of calendars that includes a first calendar. A first calendar event associated with the first calendar is detected. A second calendar included in the set of calendars and associated with the first event is determined. The second calendar is determined based on the user activity, the first calendar, or the first event. The second calendar may be determined based on a synchronization profile associated with the first calendar. The second calendar is updated to include at least a portion of the first event. The first event is synchronized and/or shared with the second calendar. Only selective portions of the event data of the first event may be provided to the second calendar.

Growing community of inventors

Ramat Gan, Israel

Haim Somech