Hewlett Packard Enterprise Development LP

Vishesh Garg

Sathyanarayanan Manamohan

Krishnaprasad Lingadahalli Shastry

Saikat Mukherjee

KrishnaPrasad Lingadahalli Shastry

A system and a method for adaptively synchronizing learning of multiple learning models are disclosed. Several local learning models are executed on multiple nodes. Learning model parameters are shared by such nodes to a master node, in multiple iterations, after a predefined synchronization interval. Such learning model parameters are aggregated and central learning models are generated based on aggregated set of learning model parameters. Accuracies of the central learning models and an average accuracy of the central learning models are determined. Accuracy of an immediate central learning model i.e. the one received after determining the average accuracy, is compared with the average accuracy. Based on the difference between the accuracy of the immediate central learning model and the average accuracy, the synchronization interval is modified, and the multiple nodes are updated about this modified synchronization interval.

Adaptively synchronizing learning of multiple learning models

Decentralized machine learning to build models is performed at nodes where local training datasets are generated. A blockchain platform may be used to coordinate decentralized machine learning (ML) over a series of iterations. For each iteration, a distributed ledger may be used to coordinate the nodes communicating via a blockchain network. A node can include self-healing features to recover from a fault condition within the blockchain network in manner that does not negatively impact the overall learning ability of the decentralized ML system. During self-healing, the node can determine that a local ML state is not consistent with the global ML state and trigger a corrective action to recover the local ML state. Thereafter, the node can generate a blockchain transaction indicating that it is in-sync with the most recent iteration of training, and informing other nodes to reintegrate the node into ML.

System and method for self-healing in decentralized model building for machine learning using blockchain

Systems and methods are provided for leveraging blockchain technology in a swarm learning context, where nodes of a blockchain network that contribute data to training a machine learning model using their own local data can be rewarded. In order to conduct such data monetization in a fair and accurate manner, the systems and methods rely on various phases in which Merkle trees are used and corresponding Merkle roots are registered in a blockchain ledger. Moreover, any claims for a reward are challenged by peer nodes before the reward is distributed.

Systems and methods for monetizing data in decentralized model building for machine learning using a blockchain

Systems and methods are provided for implementing swarm learning while using blockchain technology and election/voting mechanisms to ensure data privacy. Nodes may train local instances of a machine learning model using local data, from which parameters are derived or extracted. Those parameters may be encrypted and persisted until a merge leader is elected that can merge the parameters using a public key generated by an external key manager. A decryptor that is not the merge leader can be elected to decrypt the merged parameter using a corresponding private key, and the decrypted merged parameter can then be shared amongst the nodes, and applied to their local models. This process can be repeated until a desired level of learning has been achieved. The public and private keys are never revealed to the same node, and may be permanently discarded after use to further ensure privacy.

Secure parameter merging using homomorphic encryption for swarm learning

Decentralized machine learning to build models is performed at nodes where local training datasets are generated. A blockchain platform may be used to coordinate decentralized machine learning over a series of iterations. For each iteration, a distributed ledger may be used to coordinate the nodes. Rules in the form of smart contracts may enforce node participation in an iteration of model building and parameter sharing, as well as provide logic for electing a node that serves as a master node for the iteration. The master node obtains model parameters from the nodes and generates final parameters based on the obtained parameters. The master node may write its state to the distributed ledger indicating that the final parameters are available. Each node, via its copy of the distributed ledger, may discover the master node's state and obtain and apply the final parameters to its local model, thereby learning from other nodes.

Growing community of inventors

Bengaluru, India

Vishesh Garg