Microsoft Technology Licensing, LLC

Other

David Maxwell Chickering

David Earl Heckerman

Christopher A Meek

Robert L Rounthwaite

Bo Thiesson

Timothy S Paek

Eric J Horvitz

Alexander G Gounares

Lili Cheng

Denis X Charles

Alexei V Bocharov

Gary William Flake

Joshua T Goodman

Geoffrey John Hulten

Zhaohui Tang

Aparna Lakshmiratan

Scott Conrad Oveson

Dan Geiger

Patrice Y Simard

Carl Myers Kadie

Eric Barber Vigesaa

Paul Nathan Bennett

Allan Folting

Anton Mityagin

Brian Burdick

Carlos Garcia Jurado Suarez

Ashis Kumar Roy

Ying Li

Susan Theresa Dumais

Li Erran Li

Kamal Jain

Michael J Connolly

Tarek Najm

Paul S Bradley

Geoffrey G Zweig

Jason D Williams

Rajeev Prasad

Dane Alexander Glasgow

Jeffrey Bernhardt

Raxit A Kagalwala

Siddhartha Puri

Murali Vajjiravel

Andrey Kolobov

Nobal Bikram Niraula

Sachin Dhawan

Donald E Bradford

Pradeep Dasigi

Edith Law

Sven Seuken

Qiang Wu

Steven Mark Drucker

Bongshin Lee

Kumar Hemachandra Chellapilla

Eliot Carleton Gillum

Eric Norman Badger

Christopher Bruce Weare

George P Moromisato

Eric I Horvitz

Fileno A Alleva

Asela J Gunawardana

Usama M Fayyad

Mei-Yuh Hwang

C James MacLennan

Mohammad Mahdian

Christian Herwarth Borgs

Ewa Dominowska

Jennifer Tour Chayes

John S Breese

Saleema Amin Amershi

Daniel John Liebling

Anthony Paul Penta

Pyungchul Kim

Ryan Charles Colvin

Leon Bottou

Kevyn Breca Collins-Thompson

Reid Andersen

Paul Stephen Rehfuss

David G Grangier

Jody D Biggs

Amin Saberi

Gopalakrishnan Seshadrinathan

Jay T Buckingham

Lawrence Andrew Koch

Prasanth Pulavarthi

Jeffrey R Hemmen

Uriel Mordechai Feige

Brigham Anderson

Pradeep K Gupta

Bryan N Culbertson

Rishabh Krishnan Iyer

Benjamin Austin Carterette

Patrice Yvon Rene Simard

A hierarchical extraction model for a label hierarchy may be implemented by a weighted hierarchical state machine whose structure and/or weights are determined in part from a statistical distribution of label sequences as determined from training data. In accordance with various embodiments, the hierarchical state machine includes one or more non-cyclic directed chains of states representing at least a subset of the label sequences, and transitions weighted based at least in part on the statistical distribution.

Learning the structure of hierarchical extraction models

Domain-specific language understanding models that may be built, tested and improved quickly and efficiently are provided. Methods, systems and devices are provided that enable a developer to build user intent detection models, language entity extraction models, and language entity resolution models quickly and without specialized machine learning knowledge. These models may be built and implemented via single model systems that enable the models to be built in isolation or in an end-to-end pipeline system that enables the models to be built and improved in a simultaneous manner.

Generation of language understanding systems and methods

Technologies are described herein for active machine learning. An active machine learning method can include initiating active machine learning through an active machine learning system configured to train an auxiliary machine learning model to produce at least one new labeled observation, refining a capacity of a target machine learning model based on the active machine learning, and retraining the auxiliary machine learning model with the at least one new labeled observation subsequent to refining the capacity of the target machine learning model. Additionally, the target machine learning model is a limited-capacity machine learning model according to the description provided herein.

Active machine learning

Methods, computer systems, computer-storage media, and graphical user interfaces are provided for visualizing a performance of a machine-learned model. An interactive graphical user interface includes an item representation display area that displays a plurality of item representations corresponding to a plurality of items processed by the machine-learned model. The plurality of item representations are arranged according to scores assigned to the plurality of items by the machine-learned model. Further, each of the plurality of item representations is visually configured to represent a label assigned to a corresponding item.

Interactive visualization of machine-learning performance

Distribution displays for categories are provided which illuminate the distribution of continuous attributes over all cases in a category, and which provide a histogram of the population of the different states of categorical attributes. An array of such displays by attribute (in one dimension) and category (in another dimension) may be provided. Category diagram displays are also provided for visualizing the different categories, and their distributions, populations, and similarities. These are displayed through different shading of nodes and edges representing categories and the relationship between two categories, and through proximity of nodes.

System and method for visualization of categories

Systems and methods allow an on-line game to extract information relevant to a specific need of a game platform or service platform. The specific need relates to management and use of digital content, and is addressed by designing and playing an on-line collaborative game. The rules of the game intend to solve a specific task dictated by the specific need. Players' responses to the game generate a wealth of information related to a specific task objective, such as ranking, sorting, and evaluating a set of digital content items. To compel participation in a game, players can be rewarded with monetary value rewards. As a game illustration, an image selection game (ISG) that exploits human contextual inference is described in detail. The information extracted from ISG is a list of key-image associations, relevant for the task of image sorting and ranking.

Information collection during game play

A game description language is provided for human computation games, as well as a game platform or generator component that can generate the code base for the game. The game description language and schema framework can be used to represent the game logic and synchronization patterns of a human computation game. The automated code generation tool takes a file, e.g., a file made from the above game description language, or the like, as an input and generates a code base for the corresponding human computation game. These tools allow a prototype of a human computation game to be generated within minutes.

Arrangement for building and operating human-computation and other games

Various embodiments provide techniques for graph clustering. In one or more embodiments, a participation graph is obtained that represents relationships between entities. An auxiliary graph is constructed based on the participation graph. The auxiliary graph may be constructed such that the auxiliary graph is less dense than the participation graph and is therefore computationally less complex to analyze. Clusters in the auxiliary graph are determined by solving an objective function defined for the auxiliary graph. Clusters determined for the auxiliary graph may then be utilized to ascertain clusters in the participation graph that solve a related objective function defined for the participation graph.

Graph clustering

The claimed subject matter relates to an architecture that can facilitate verification or feedback in association with consumer transactions. In particular the architecture can image a transaction receipt, translate the image into text-based data, and extract relevant transaction data there from. Such relevant transaction data can be saved to a data store maintained or supervised by the customer and/or transmitted to authorized components that can benefit from data related to transaction histories, verification, and/or feedback.

Feedback loop for consumer transactions

One or more systems and/or techniques are provided for constructing a query classification index that can be used to classify a query into relevant categories. Where documents in an index are classified into one or more category predictions for a category hierarchy, classification metadata is generated for categories to which a document in the index has been classified. Further, the classification metadata is associated to the corresponding documents in the index. Additionally, a query of the index can be classified using the metadata associated to the documents in the index, and query results can be provided that are classified by the one or more categories identified by the classification of the query.

Query classification

Providing a market design for a peer-to-peer resource exchange system. Prices for a plurality of resources such as storage space, upload bandwidth, and download bandwidth are calculated and balanced based on previous resource prices, a supply of the resources, and a demand for the resources. Further, prices for operations such as storage and retrieval are determined such that a total of the payments to resource suppliers equals a total of the payments received from the resource consumers. In some embodiments, incoming data operation requests are allocated to the peers such that equilibrium among the peers is achieved.

Market design for a resource exchange system

Counterfactual analysis can be performed 'offline', or 'after the fact', based on data collected during a trial in which random variations are applied to the output of the system whose parameters are to be the subject of the counterfactual analysis. A weighting factor can be derived and applied to data collected during the trial to emphasize that data obtained when the random variations most closely resembled the output that would be expected if counterfactual parameters were utilized to generate the output. If the counterfactual parameters being considered differ too much from the parameters under which the trial was conducted, the offline counterfactual analysis can estimate a direction and magnitude of the change of the system performance, as opposed to deriving a specific expected system performance value. In economic transactions, the random variations can be considered variations in the price paid by another party, thereby enabling derivation of their marginal cost.

Offline counterfactual analysis

Embodiments of the invention relate to an architecture or extension to a window manager. In particular, the extension can provide for a window rotation feature that can be exposed as a rotate button. Additionally or alternatively, the rotation feature can be activated based upon a diverse set of conditions, events, and/or commands. Upon activation of the rotation feature, the window manager can rotate a window about an axis to expose a secondary surface that can be populated with alternative content that is distinct from the content of the primary surface of the window. In addition, the architecture provides techniques for identifying both double-sided graphical objects and potentially double-sided objects.

Providing alternative content in a windowed environment

Useful information is acquired from a community of individuals by way of a game that rewards participants with social information about other participants. Points can be awarded to participants simply for participation and/or as a function of game performance. Such points can subsequently be exchanged to reveal information about game partners or other community members. Among other things, such a reward system can motivate individuals to perform tasks that might not otherwise be compelling and/or enjoyable.

Social rewards for online game playing

Growing community of inventors

Bellevue, WA, United States of America

David Maxwell Chickering