Microsoft Technology Licensing, LLC

Michael Francis Palermiti, Ii

Ashok Kuppusamy

Jonathan Reed Harris

Jaclyn Carley Knapp

Jesse Daniel Eskes Rusak

Richard Leigh Mains

Jayant Sivarama Krishnamurthy

Chad Steven Estes

Harris Syed

Allison Anne O'Mahony

David Ernesto Heekin Burkett

Diego Hernan Carlomagno

Talon Edward Ireland

Jose Miguel Rady Allende

Andrew Paul McGovern

Viktoriya Taranov

Tali Roth

Miles Cole Fitzgerald

Tudor Buzasu Klein

Sergiy Gavrylenko

Yuan Wei

Wayne Sun

Amund Kronen Johansen

Dag Steinnes Eidesen

Scott M Stiles

Megan Marie Quintero

Matthew D Wood

Poonam Ganesh Hattangady

William X Yang

Krister Mikalsen

Roshin Lal Ramesan

Susan Marie Grimshaw

Amy Harilal Rambhia

Bryan P Ferguson

Caleb Whitmore

Robin Counts

Kuleen Haresh Mehta

Alan Mark Thomas

Anton Oguzhan A Andrews

Erich Jose Martino Pena

Andrew Paul Mcgovern

Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. Such heavy integration also allows particular embodiments to support multi-modal input from a user for a single conversational interaction. In this way, client application user interface interactions, such as clicks, touch gestures, or text inputs are executed alternative or in addition to the voice utterances.

Voice assistant-enabled client application with user view context and multi-modal input support

An electronic message computing system tracks new activity items that reflect activities that have not yet been seen by the user. A. generative artificial intelligence (AI) model generates a digest summary that is provided to the user the next time the user accesses the electronic message system. The digest summary summarizes new activity. The generative AI model also generates importance summaries that summarize the importance of a particular activity to the user, and content summaries that summarize the content of an activity item (such as an electronic mail message). The electronic messaging system also assigns a priority to each new activity item and provides the summaries, along with a priority, to a client computing system. The client computing system conducts a user experience, navigating the user through the new activity items, based upon the priority assigned by the electronic message computing system.

Electronic message system with artificial intelligence (AI)-generated personalized summarization

Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to both perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. For example, some embodiments can automatically and intelligently cause a switch to a page the user needs and automatically and intelligently cause a population of particular fields of the page the user needs based on a user view context and the voice utterance.

Voice assistant-enabled client application with user view context

A method for proactively providing information to a user about an event involving the user includes receiving user input indicating a request to display a search page and displaying the search page in response to the user input. In addition, event information may be automatically obtained and displayed on the search page in response to the user input. Some examples of event information that may be provided include participant information about a participant in the event other than the user, file information about a file that is relevant to the event, and conversation information about a conversation that is relevant to the event.

Proactively displaying relevant information related to an event on a search page

A system and method for surfacing content relevant is described. The system computes a rank score for each item of a plurality of items that are accessible from a user of an enterprise application. The system identifies a set of relevant items from the plurality of items based on the rank score for each item of the plurality of items. The system surfaces the set of relevant items within a context of a communication application of the user without receiving, from the user, a query for any of the items in the set of relevant items.

Preemptively surfacing relevant content within email

User interaction efficiency is improved by providing automatic enrichment of content with contextually relevant information. While a user is utilizing a productivity application, the system may receive a content item, such as an email or calendar event, to display within an application user interface. The system analyzes and identifies contextually relevant information based on the content item. Thereafter, the system displays the application user interface including the content item which is modified to display the contextually relevant information within the content item.

Auto-enrichment of content

Many software applications allow users to consume and interact with a variety of data, such as files, photos, web pages, emails, and/or other content. Because the amount of content may be cumbersome to sift through, software applications may provide filtering and searching capabilities to aid users in finding desired content. However, the trial and error involved in current searching techniques may be time consuming and/or diminish the user's experience. Accordingly, one or more systems and/or techniques for presenting visual previews of search results are disclosed herein. In particular, a user may reference an identifier (e.g., 'Bill') that may be used as search criteria to retrieve corresponding objects (e.g., photos of Bill). A visual preview of the retrieved objects may be presented to the user. The user may quickly view visual previews of search results by referencing various identifiers without committing to a particular search result set.

Visual preview of search results

Image management applications allow users to upload, modify, organize, search, and/or share images. Unfortunately, current image management applications may have separate search modes and tagging modes. Accordingly, one or more systems and/or techniques for providing a user with a seamlessly integrated search, view, and/or tag experience are disclosed herein. Search results comprising tagged images and untagged images may be provided in response to a user search query. The untagged images may be contextually relevant to features of the tagged images and/or the user search query. Tagging suggestions for untagged images may be presented that allow a user to confirm or deny a tagging suggestion for an untagged image. Additionally, confirmable thumbnails corresponding to the untagged images may be presented. A confirmable thumbnail may allow a user to confirm or deny tagging a corresponding untagged image.

Image searching with recognition suggestion

Growing community of inventors

Sammamish, WA, United States of America

Michael Francis Palermiti, Ii