Microsoft Technology Licensing, LLC

Christopher Andrews Jung

Erez Kikin Gil

Humberto Lezama Guadarrama

Benjamin David Smith

Benjamin Gustav Wilde

Daniel Paul Costenaro

Seth Fox

Brian Daniel Meersma

Sophia Isabel Vennix

Kyle Patrick Curlett

Natalie Ann Mionis

Leeviana Peng Gray

Yan Zhong Leigh

Marian Kimberley Chua

Michael Schreiber

Sebastien Rene Vandenberghe

Erez Kikin-Gil

David Benjamin Lee

Suzan Marashi

Charles Scott Walker

Amy Huyen Phuoc Nguyen

Ravin Sachdeva

Thomas Constantin

Haroon Dawood Barri

Luiz Gustavo Bustamante Magalhaes

Ming Wu

Anav Silverman

Gustavo Santos

Vanessa Harris

Garett Yoshiharu Sakamoto

Izis De Melo Moreira

Ragavenderan Venkatesan

Tricia Lybrook

Daniel F Holme

Matthew Sledge Epstein

TszYan C Zogg

Zhiguo Yu

Lutfi Ilke Kaya

Stephanie Sharp

Dianne Patricia Lobo

Giovannah Lizette Webb

Anne O'Neill

Suzanne Tocco

David Lee

Systems and methods are provided for automatically determining an intent of a user based on an intent model to attach a file to a document, prompting the user to confirm the intent using a predetermined character in an inline nudge, generating and displaying an inline menu with an interactive list of ranked files as a suggestion for attachment. The disclosed technology uses the intent for specifying a scope of the inline search. The intent model for attaching content maintained by third-party applications uses a combination of an embeddings model and an N-gram model with limited seed queries and determines the intent based on intent scores associated with respective third-party applications. The present disclosure ranks respective candidate content based on a degree of relevance to the intent. The user selects one or more content from the list for attaching to the document.

Inline search based on intent-detection

Traditional messaging applications (such as email, social networking platforms, text, instant messaging, chat, etc.) are ill-equipped for collaboration. For instance, a sender and recipients corresponding regarding a topic are often required to exchange multiple messages. As a result, determining a consensus regarding the topic or summarizing the collaboration is difficult and cumbersome. Moreover, when links are included in messages, recipients are required to navigate away from the messaging application to view the linked content. A messaging application is provided that may be configured to enable users to dynamically collaborate regarding links or data within a sent message or a receive message. In aspects, a collaborative user experience (UX) is provided, which may be an interface within a message that enables real-time collaboration between a sender and one or more recipients regarding message content—without exchanging additional messages or navigating away from the messaging application.

Converting links and static data into collaborative user experiences

Traditional messaging applications (such as email, social networking platforms, text, instant messaging, chat, etc.) are ill-equipped for collaboration. For instance, a sender and recipients corresponding regarding a topic are often required to exchange multiple messages. As a result, determining a consensus regarding the topic or summarizing the collaboration is difficult and cumbersome. Moreover, when links are included in messages, recipients are required to navigate away from the messaging application to view the linked content. A messaging application is provided that may be configured to enable users to dynamically collaborate regarding links or data within a sent message or a receive message. In aspects, a collaborative user experience (UX) is provided, which may be an interface within a message that enables real-time collaboration between a sender and one or more recipients regarding message content&#x2014;without exchanging additional messages or navigating away from the messaging application.

The present disclosure relates to processing operations that generate and present personalized content suggestions to assist a user with document creation. Machine learning modeling may be trained and implemented to evolve pre-canned suggestions for document creation into highly personalized content suggestions, thereby improving the document creation process and user interface experience for users of applications/services that are utilized to create digital documents. As an example, signal data may be detected and analyzed, identifying a specific user's intent to create a digital document. Machine learning modeling may be implemented to evaluate different aspects of collected signal data and identify content from previously created documents, associated with a user account, that may be most relevant to the real-time document creation experience of the user. Personalized contextual suggestions may be presented to a user through a user interface. Examples described herein may be extensible across any type of application/service configured for document creation.

Personalization of content suggestions for document creation

An email system detects a user interaction to interact with a social media application, within the email system. The email system accesses a social media component that renders a user interface from the social media system and detects interactions with the user interface to generate content for the social media application. The social media component calls the social media application, with the content, and provides a response indicating that the content has been sent to the social media application.

Creation and consumption of non-electronic mail (email) social media content from within an email system

Collaborator content selection and manipulation actions and comments during interaction with a document are recorded to enhance asynchronous collaboration. The collaborator content selection and manipulation actions and comments are recorded during interaction with a document in a first collaboration viewport at a first time and played back in a second collaboration viewport at a second time while the same or a different instance of the document is displayed. The collaborator content selection and manipulation actions and comments include at least text selection, mouse or pen movements, and voice comments or ink annotations that are played back to recreate the collaborator changes and comments as though they were occurring in real-time, thereby creating a user experience that is more like the 'over the shoulder' collaboration that would be available to collaborators that are at the same physical location.

View playback to enhance collaboration and comments

A system configured intelligently reusing content and format is provided. The system receives a selection of data to be copied and an indication to copy the selected data and copies the selected data. The system receives an indication to paste the selected data at a second location. The selected data is analyzed to determine one or more options available for the paste, whereby each of the options being selectable to change an aspect of the selected data being pasted. The one or more options and an image of a placeholder representing the selected data are presented at the second location. The system receives a selection of an option from the one or more options. In response to receiving the selection of the option, the system causes presentation of the selected data in place of the image of the placeholder based on the selected option.

Intelligent content and formatting reuse

An application can provide a UI that includes UI elements for defining talking points to be discussed in conjunction with slides in a presentation file. The application can also provide a UI for assisting a user while the user is making a presentation using a presentation file for which talking points have been defined. For example, the application can recognize the speech of a presenter during a presentation and identify topics within the recognized speech. The application can then identify the talking points that the presenter has discussed based upon their identified topics. The application can also provide a presenter view UI that includes UI elements that display data identifying the talking points that have not been recognized within the user's speech during the presentation. In this way, a presenter can quickly identify the talking points that they have covered and those that they have not covered in real-time.

Human-computer interface for navigating a presentation file

The systems and techniques disclosed here feature a device including an audio analyzer connected to microphone(s) monitoring a conversation between one or more individuals. The audio analyzer can identify auditory expressions from audio captured by the microphone, where the auditory expressions can include linguistic expressions and nonlinguistic expressions. The audio analyzer can analyze the linguistic expressions to identify a topic and a time period when the topic was discussed. A video analyzer can be connected to camera(s) monitoring the conversation. The video analyzer can identify non-auditory expressions by the individuals from video captured by the camera. A sentiment analyzer can analyze auditory expressions during the time period when the topic was discussed and non-auditory expressions during the time period when the topic was discussed to determine sentiments to the topic. A processor can analyze the determined sentiments to the topic to determine a group sentiment to the topic.

Generating a synopsis of a meeting

Examples described herein improve the way in which a transcript is generated and displayed so that the context of a conversation taking place during a meeting or another type of collaboration event can be understood by a person that reviews the transcript (e.g., reads or browses through the transcript). The techniques described herein use voice recognition to identify a user that is speaking during the meeting. Accordingly, when the speech of the user is converted to text for the transcript, the text can be attributed to the identified user. The techniques described herein further configure a graphical user interface layout, in which the transcript can be displayed. The graphical user interface layout enables users to better understand the context of a conversation that takes place during a meeting.

Use of voice recognition to generate a transcript of conversation(s)

Generally discussed herein are devices, systems, and methods for an insertion and/or modification control object. A method for using a user interface (UI) of a computing device may include selecting, using a user input device and releasing a control object using the UI, selecting a first object to insert below one or more items shown on the UI, wherein the first object is one of a first set of objects shown on the UI in response to releasing the control object, selecting and dragging the control object to a location between two of the items on the UI, releasing the control object at the location, and selecting a second object to insert at the location between the items, wherein the second object is one of the first set of objects shown on the UI in response to releasing the control object.

Drag and drop insertion control object

Non-limiting examples of the present disclosure describe automatic creation of a composite data object from a received drag and drop action. A drag and drop action is received through a user interface of a productivity service. The drag and drop action is analyzed, where an analysis comprises: evaluation of attributes of data objects of the drag and drop action, evaluation of a relationship between the data objects and a determination of user intent for the drag and drop action based on a placement of the first data object onto a position of the second data object. A group type is created that comprises an arrangement of the first data object and the second data object based on the analysis of the drag and drop action. A representation of a composite data object is surfaced, through the user interface, based on the created group type.

Drag and drop of objects to create new composites

Growing community of inventors

Seattle, WA, United States of America

Christopher Andrews Jung