The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 27, 2021

Filed:

May. 03, 2018
Applicant:

Beijing Didi Infinity Technology and Development Co., Ltd., Beijing, CN;

Inventors:

Zhiwei Qin, San Jose, CA (US);

Ishan Jindal, Detroit, MI (US);

Xuewen Chen, Mountain View, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G01C 21/34 (2006.01); G06Q 10/04 (2012.01); G06Q 30/02 (2012.01);
U.S. Cl.
CPC ...
G01C 21/3438 (2013.01); G01C 21/343 (2013.01); G01C 21/3453 (2013.01); G06Q 10/047 (2013.01); G06Q 30/0284 (2013.01);
Abstract

A method may comprise recursively performing: (1) providing one or more states of a simulation environment to a simulated vehicle, and the states comprise a first current time and a first current location of the simulated vehicle; (2) obtaining an action by the simulated vehicle when the simulated vehicle has reached a milestone, wherein: the action is selected from: waiting at the first current location of the simulated vehicle, picking up a passenger group A at an origin of passenger group A's transportation, and dropping off a passenger group B at a destination of passenger group B's transportation, and the milestone is an origin or a destination of any passenger group's transportation; (3) determining a reward to the simulated vehicle for the action; and (4) updating the one or more states based on the action to obtain one or more updated states for providing to the simulated vehicle.


Find Patent Forward Citations

Loading…