International Business Machines Corporation

Syed Amer Zawad

Nathalie Baracaldo Angel

Ali Anwar

Yi Zhou

Kamala Micaela Noelle Varma

A federated learning method comprises creating a log of previously provided gradients from a plurality of workers, receiving updated gradients from the plurality of workers, calculating a vulnerability weight for each layer of a global machine learning model using the updated gradients, calculating an aggregated gradient using the vulnerability weight and the updated gradients, and updating the global machine learning model using the aggregated gradient. Some embodiments may also determine whether a Byzantine attack is occurring based upon the calculated aggregated gradient. An apparatus and computer program product may be used to implement the method.

Byzantine-robust federated learning

An indication of availability over time and resource usage is maintained for each computing device of a plurality of computing devices. An optimal combination of a subset of the plurality of computing devices is determined for each round of one or more rounds of training based on the availability over time and the resource usage for each computing device. A global model is generated utilizing the one or more optimal combinations of the plurality of computing devices and a query is performed utilizing the global model.

Growing community of inventors

Reno, NV, United States of America

Syed Amer Zawad