The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 02, 2022

Filed:

Apr. 10, 2020
Applicant:

Robert Bosch Gmbh, Stuttgart, DE;

Inventors:

Andreas Doerr, Stuttgart, DE;

Christian Daniel, Leonberg, DE;

Michael Volpp, Stuttgart, DE;

Assignee:

Robert Bosch GmbH, Stuttgart, DE;

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
G05B 13/02 (2006.01); G05B 13/04 (2006.01); G06F 17/18 (2006.01); G06N 3/08 (2006.01);
U.S. Cl.
CPC ...
G05B 13/029 (2013.01); G05B 13/041 (2013.01); G06F 17/18 (2013.01); G06N 3/08 (2013.01);
Abstract

A system is described for configuring another system, e.g., a robotics system. The other system interacts with an environment according to a deterministic policy by repeatedly obtaining, from a sensor, sensor data indicative of a state of the environment, determining a current action, and providing, to an actuator, actuator data causing the actuator to effect the current action in the environment. To configure the other system, the system optimizes a loss function based on an accumulated reward distribution with respect to a set of parameters of the policy. The accumulated reward distribution includes an action probability of an action of a previous interaction log being performed according to the current set of parameters. The action probability is approximated using a probability distribution defined by an action selected by the deterministic policy according to the current set of parameters.


Find Patent Forward Citations

Loading…