Huawei Cloud Computing Technologies Co., Ltd.

Yutao Huang

Yong Zhang

Lanjun Wang

Lingyang Chu

A machine learning model is learned using secure vertical federated learning by receiving, by a network machine learning model, from a plurality of private machine learning models, a set of private machine learning model outputs. The set of private machine learning model outputs is based on data owned exclusively by each of the plurality of private machine learning models. The set of private machine learning model machine learning outputs is aligned based on sample IDs of the data. The network machine learning model, a prediction, the prediction being the output of the network model based on the set of private machine learning model outputs. Transmitting, by the network model, the prediction, to one of the plurality of private machine learning models, the one of the plurality of private machine learning models comprising labels. Receiving, by the network model, from the one of the plurality of private machine learning models, a loss based on the labels and the prediction, and calculating a gradient based on the loss, and updating a parameter of the network model based on the loss.

Method, apparatus and system for secure vertical federated learning

Methods and systems for horizontal federated learning are described. A plurality of sets of local model parameters is obtained. Each set of local model parameters was learned at a respective client. For each given set of local model parameters, collaboration coefficients are computed, representing a similarity between the given set of local model parameters and each other set of local model parameters. Updating of the sets of local model parameters is performed, to obtain sets of updated local model parameters. Each given set of local model parameters is updated using a weighted aggregation of the other sets of local model parameters, where the weighted aggregation is computed using the collaboration coefficients. The sets of updated local model parameters are provided to each respective client.

Growing community of inventors

Port Moody, Canada

Yutao Huang