Microsoft Technology Licensing, LLC

Jin A Suh

Gonzalo Alberto Ramos

Steven Mark Drucker

Christopher A Meek

Patrice Y Simard

Shiqian Rachel Ng

Haekyu Park

Johannes H Verwey

Nan-Chen Chen

Mary P Czerwinski

Bongshin Lee

Ashish Kapoor

Saleema Amin Amershi

Daniel J McDuff

Kael R Rowan

Javier Hernandez Rivera

Prasanth Murali

Mohammad Akram

Michael J Brooks

Napol Rachatasumrit

A document re-finding system generates embeddings for concept clips provided by a user, the concept clips defining a concept for searching for content of interest to the user in a plurality of documents previously seen by the user. The re-finding system determines semantic relationships between the concept and document clips, related to respective document among the plurality of documents, based on the concept embedding and embeddings generated for the document clips. A graphical user interface depicting the semantic relationships is rendered to the user and is operable to enable re-finding a document, among the plurality of documents, having the content of interest to the user.

Document re-finding system

The present disclosure relate to highlighting audience members with reactions to a presenter of an online meeting. Unlike physical, fact-to-face meeting that enables spontaneous interactions among the presenter and the audiences that are collocated with the presenter, presenting materials during an online meeting raises an issue of the present not being able to see real-time reactions or feedback by the audience members. The present disclosure addresses the issue by dynamically determining one or more audience members who indicate reactions during the online meeting or presentation and displaying faces of the one or more audience members under spotlight to the presenter. The presenter sees faces of the audience members with reactions during the online presentation and responds to the audience members and keep the audience engaged. The spotlight audience server analyzes video frames and determines types of reactions of the audience members.

Highlighting expressive participants in an online meeting

In examples, a schema augmentation system for exploratory research leverages intelligence from a machine learning model to augment such tasks by leveraging intelligence derived from machine learning capabilities. Augmenting tasks include schematization of content, such as information units and groupings of information units. Based on the schematization of such content, semantic proximities for information units are determined. The semantic proximities may be used to identify and present potentially relevant information units, for example to accelerate the exploratory research task at hand. As such, users engaged in consumption of heterogeneous content (e.g., across client applications and/or content sources), may receive machine-augmented support to find potential information units. To optimize machine training, user input may be received, such that the system may intelligently augment the user's exploratory research task based on the semantic coherence of the content processed from information units and associated user behavior.

Schema augmentation system for exploratory research

Classification predictions made by a concept classifier may be interactively visualized and explored in a user interface that displays visual representations of a plurality of data items in a star coordinate space spanned by a plurality of anchor concepts each mapping the data items onto respective finite real-valued scores. Positions of the visual representations of the data items in the star coordinate space are based on the scores for the plurality of anchor concepts, and may be updated responsive to a user manipulating the anchor concepts in the user interface, e.g., by moving or modifying definitions of anchor concepts, or by adding or deleting anchor concepts. The visual representations of the data items may reflect labels and/or classification predictions, and may be updated based on updated classification predictions following retraining the of the concept classifier based on added training data or new features.

Interactive semantic data exploration for error discovery

Classification predictions made by a concept classifier may be interactively visualized and explored in a user interface that displays visual representations of a plurality of data items in a star coordinate space spanned by a plurality of anchor concepts each mapping the data items onto respective finite real-valued scores. Positions of the visual representations of the data items in the star coordinate space are based on the scores for the plurality of anchor concepts, and may be updated responsive to a user manipulating the anchor concepts in the user interface, e.g., by moving or modifying definitions of anchor concepts, or by adding or deleting anchor concepts. The visual representations may of the data items may reflect labels and/or classification predictions, and may be updated based on updated classification predictions following retraining the of the concept classifier based on added training data or new features.

Disclosed herein are technologies directed to a feature ideator. The feature ideator can initiate a classifier that analyzes a training set of data in a classification process. The feature ideator can generate one or more suggested features relating to errors generated during the classification process. The feature ideator can generate an output to cause the errors to be rendered in a format that provides for an interaction with a user. A user can review the summary of the errors or the individual errors and select one or more features to increase the accuracy of the classifier.

Error-driven feature ideation in machine learning

Growing community of inventors

Seattle, WA, United States of America

Jin A Suh