Microsoft Technology Licensing, LLC

Linkedin Corporation

Joel Daniel Young

Xu Miao

Yitong Zhou

Lijun Tang

Anmol Bhasin

Eric Huang

David J Stein

Songxiang Gu

Chang-Ming Tsai

Honglei Zhuang

Shaunak Chatterjee

Weidong Zhang

Bee-Chung Chen

Fei Chen

Grace W Tang

Sumit Rangwala

Boyi Chen

Wei Zhuang

Amit Chandak

Wenxuan Gao

Paul Taylor Ogilvie

David Hardtke

Da Teng

Xuebin Yan

Priyanka Gariba

Lance M Wall

Andris Birkmanis

Varnit Agnihotri

Divya Gadde

Ruoyang Wang

Amit Yadav

Yangchun Luo

Ke Wu

The disclosed embodiments provide a system for processing data. During operation, the system obtains a feature configuration for a feature. Next, the system obtains, from the feature configuration, an anchor containing metadata for accessing the feature in an environment. The system then uses one or more attributes of the anchor to retrieve one or more feature values of the feature from the environment. Finally, the system provides the one or more feature values for use with one or more machine-learning models.

Framework for managing features across environments

The disclosed embodiments provide a system for processing data. During operation, the system obtains a function call for a function that calculates an attribute associated with a machine learning model. For each argument of the function call, the system identifies a parameter type of the argument, wherein the parameter type represents a type of data used with the machine learning model. The system also obtains a value accessor for retrieving features specific to the parameter type and obtains a value represented by the argument using the value accessor. The system then calculates the attribute by applying the function to the value and uses the attribute to execute the machine learning model.

Unified parameter and feature access in machine learning models

The disclosed embodiments provide a system for processing data. During operation, the system obtains a hierarchical representation containing a set of namespaces of a set of features shared by a set of statistical models. Next, the system uses the hierarchical representation to obtain, from one or more execution environments, a subset of the features for use in calculating the derived feature. The system then applies a formula from the hierarchical representation to the subset of the features to produce the derived feature. Finally, the system provides the derived feature for use by one or more of the statistical models.

Common feature protocol for collaborative machine learning

The disclosed embodiments provide a method and system for performing regularized model adaptation for in-session recommendations. During operation, the system obtains, from a server, a first global version of a statistical model. During a first user session with a user, the system improves a performance of the statistical model by using the first global version to output one or more recommendations to the user and using the first global version and user feedback from the user to create a first personalized version of the statistical model. At an end of the first user session, the system transmits an update containing a difference between the first personalized version and the first global version to the server for use in producing a second global version of the statistical model by the server.

Regularized model adaptation for in-session recommendations

A system and method for managing asynchronously receiving updates and merging updates into global versions of a statistical model using version control are disclosed. During operation, the system transmits a first global version of a statistical model to a set of client computer systems. Next, the system obtains, from a first subset of the client computer systems, a first set of updates to the first global version. The system then merges the first set of updates into a second global version of the statistical model. Finally, the system transmits the second global version to the client computer systems asynchronously from receiving a second set of updates to the first and/or second global versions from a second subset of the client computer systems.

Version control for asynchronous distributed machine learning

In order to address annotation bias in batch annotations, obtained via crowdsourcing, on a set of comments on user posts in a social network, a system determines an annotation probability distribution based on a factor-graph model of the batch annotations. In particular, during operation the system computes the factor-graph model that represents relationships between feature vectors that represent the comments and the annotations for the comments. Note that, for a given batch of k comments, the factor-graph model may include a statistically dependent combination of statistically independent models of the interrelationships between the feature vectors and the annotations for the k comments. Then, the system calculates the annotation probability distribution based on model parameters associated with the factor-graph model, a mapping function that maps from the feature vectors to the annotations, and an indicator function that represents the annotations for the comments in the batches.

Annotation probability distribution based on a factor graph

In order to leverage annotation bias in batch annotations, obtained via crowdsourcing, on a set of comments on user posts in a social network, a system may select a subset of the comments for annotation based on how informative expected annotations for the comments in the subset are for the one or more classifiers and probabilities of occurrence of the expected annotations based on a predetermined annotation probability distribution. Note that the classifier may predict how likely the expected annotations are accurate for the comments in a given subset. Moreover, the predetermined annotation probability distribution may specify the annotation bias. In this way, the system may use the annotation bias to select the subset that is likely to receive expected annotations and, thus, are that are easier to use in training the classifier.

Leveraging annotation bias to improve annotations

Learning to rank modeling in the context of an on-line social network is described. A learning to rank model can learn from pairwise preference (e.g., job posting A is more relevant than job posting B for a particular member profile) thus directly optimizing for the rank order of job postings for each member profile. With ranking position taken into consideration during training, top-ranked job postings may be treated by a recommendation system as being of more importance than lower-ranked job postings. In addition, a learning to rank approach may also result in an equal optimization across all member profiles and help minimize bias towards those member profiles that have been paired with a larger number of job postings.

Learning a ranking model using interactions of a user with a jobs list

Growing community of inventors

Milpitas, CA, United States of America

Joel Daniel Young