The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 18, 2020

Filed:

Aug. 21, 2018
Applicant:

Cummins Inc., Columbus, IN (US);

Inventors:

Kartavya Neema, Columbus, IN (US);

Vikas Narang, Columbus, IN (US);

Govindarajan Kothandaraman, Columbus, IN (US);

Shashank Tamaskar, West Lafayette, IN (US);

Assignee:

Cummins Inc., Columbus, IN (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
F02D 41/24 (2006.01); F02D 41/14 (2006.01); F02D 41/00 (2006.01); G06N 3/08 (2006.01); F02D 41/18 (2006.01); F02D 41/28 (2006.01); G06N 20/00 (2019.01);
U.S. Cl.
CPC ...
F02D 41/2441 (2013.01); F02D 41/0062 (2013.01); F02D 41/1479 (2013.01); F02D 41/18 (2013.01); F02D 41/2438 (2013.01); F02D 41/2445 (2013.01); F02D 41/2451 (2013.01); F02D 41/2454 (2013.01); F02D 41/28 (2013.01); G06N 3/08 (2013.01); G06N 20/00 (2019.01); F02D 2041/281 (2013.01); F02D 2200/0406 (2013.01);
Abstract

An engine system includes an air handling and fuel system whose states are managed by a reference managing unit. The engine system has a plurality of sensors whose sensor signals at least partially define a current state of the engine system. The reference managing unit includes a controller which controls the air handling and fuel system of the engine system as well as a processing unit coupled to the sensors and the controller. The processing unit includes an agent which learns a policy function that is trained to process the current state, determines air handling references and fuel system references by using the policy function after receiving the current state as an input, and outputs the air handling references and fuel system references to the controller. Then, the agent receives a next state and a reward value from the processing unit and updates the policy function using a policy evaluation algorithm and a policy improvement algorithm based on the received reward value. Subsequently, the controller controls the air handling and fuel system of the engine in response to receiving the air handling references and the fuel system references.


Find Patent Forward Citations

Loading…