Robert Bosch Gmbh

Jared Evans

Christoph Kroener

Reinhardt Klein

Nikhil Ravi

Methods and systems for smoothening the transition of reward systems or datasets for actor-critic reinforcement learning models. A reinforcement model such as an actor-critic model is trained on a first dataset and a first reward system. The weights of the actor model and the critic model are frozen. While these weights are frozen, an affine transformation layer is attached to a final layer of the critic model, and the affine transformation layer is trained with a second dataset and a second reward system in order to adjust a weight of the final layer of the critic model. Then, the weights of the critic model are unfrozen which allows the adjusted weight of the final layer of the critic model to be implemented. The reinforcement learning model is retrained on the second dataset and second reward system, first with just the critic weights unfrozen, and then with both actor and critic weights unfrozen.

Smoothed reward system transfer for actor- critic reinforcement learning models

Methods and systems of optimizing battery charging are disclosed. Battery state sensors are used to determine anode overpotential of a battery multiple times during multiple charge cycles. In a first phase, a reinforcement learning model (e.g., actor-critic model) is trained with rewards given throughout each charge cycle of the battery to optimize training. The reinforcement learning model can determine state-of-health characteristics of the battery over the charge cycles, and in a second phase, the reinforcement learning model is augmented accordingly. During this augmentation, the reinforcement learning model is trained with rewards given on a charge cycle-by-cycle basis, wherein rewards are given after looking at the charging optimization after the conclusion of each charge cycle. Commands are given to charge an on-field battery based on the augmented reinforcement learning model, associated state-of-health characteristics of the on-field battery are determined, and the reinforcement learning model is further augmented accordingly.

Growing community of inventors

Sunnyvale, CA, United States of America

Jared Evans