The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 28, 2021

Filed:

Nov. 30, 2018
Applicants:

Denso International America, Inc., Southfield, MI (US);

Sriram Subramanian, Waterloo, CA;

Sushrut Bhalla, Waterloo, CA;

Jaspreet Sambee, Waterloo, CA;

Mark Crowley, Waterloo, CA;

Sebastian Fischmeister, Waterloo, CA;

Donghyun Shin, Waterloo, CA;

William Melek, Waterloo, CA;

Baris Fidan, Waterloo, CA;

Ami Woo, Waterloo, CA;

Bismay Sahoo, Waterloo, CA;

Inventors:

Zhiyuan Du, West Bloomfield, MI (US);

Joseph Lull, South Haven, MI (US);

Rajesh Malhan, Troy, MI (US);

Sriram Subramanian, Waterloo, CA;

Sushrut Bhalla, Waterloo, CA;

Jaspreet Sambee, Waterloo, CA;

Mark Crowley, Waterloo, CA;

Sebastian Fischmeister, Waterloo, CA;

Donghyun Shin, Waterloo, CA;

William Melek, Waterloo, CA;

Baris Fidan, Waterloo, CA;

Ami Woo, Waterloo, CA;

Bismaya Sahoo, Waterloo, CA;

Assignees:

DENSO International America, Inc., Southfield, MI (US);

Other;

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G05D 1/00 (2006.01); G05D 1/02 (2020.01); G06N 3/04 (2006.01); G06N 3/08 (2006.01);
U.S. Cl.
CPC ...
G05D 1/0088 (2013.01); G05D 1/0221 (2013.01); G06N 3/0454 (2013.01); G06N 3/08 (2013.01); G05D 2201/0213 (2013.01);
Abstract

A RLP system for a host vehicle includes a memory and levels. The memory stores a RLP algorithm, which is a multi-agent collaborative DQN with PER algorithm. A first level includes a data processing module that provides sensor data, object location data, and state information of the host vehicle and other vehicles. A second level includes a coordinate location module that, based on the sensor data, the object location data, the state information, and a refined policy provided by the third level, generates an updated policy and a set of future coordinate locations implemented via the first level. A third level includes evaluation and target neural networks and a processor that executes instructions of the RLP algorithm for collaborative action planning between the host and other vehicles based on outputs of the evaluation and target networks and to generate the refined policy based on reward values associated with events.


Find Patent Forward Citations

Loading…