The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Oct. 11, 2022
Filed:
May. 15, 2019
Baidu Usa Llc, Sunnyvale, CA (US);
Runxin He, Sunnyvale, CA (US);
Jinyun Zhou, Sunnyvale, CA (US);
Qi Luo, Sunnyvale, CA (US);
Shiyu Song, Sunnyvale, CA (US);
Jinghao Miao, Sunnyvale, CA (US);
Jiangtao Hu, Sunnyvale, CA (US);
Yu Wang, Sunnyvale, CA (US);
Jiaxuan Xu, Sunnyvale, CA (US);
Shu Jiang, Sunnyvale, CA (US);
BAIDU USA LLC, Sunnyvale, CA (US);
Abstract
In one embodiment, a system uses an actor-critic reinforcement learning model to generate a trajectory for an autonomous driving vehicle (ADV) in an open space. The system perceives an environment surrounding an ADV. The system applies a RL algorithm to an initial state of a planning trajectory based on the perceived environment to determine a plurality of controls for the ADV to advance to a plurality of trajectory states based on map and vehicle control information for the ADV. The system determines a reward prediction by the RL algorithm for each of the plurality of controls in view of a target destination state. The system generates a first trajectory from the trajectory states by maximizing the reward predictions to control the ADV autonomously according to the first trajectory.