The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 19, 2020

Filed:

Dec. 20, 2019
Applicant:

Alibaba Group Holding Limited, Grand Cayman, KY;

Inventors:

Xingwen Zhang, San Mateo, CA (US);

Hao Lu, San Mateo, CA (US);

Zhigang Hua, San Mateo, CA (US);

Shuang Yang, San Mateo, CA (US);

Assignee:

Alibaba Group Holding Limited, Grand Cayman, KY (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G01C 21/00 (2006.01); G01C 21/34 (2006.01); G06Q 10/04 (2012.01); G06N 20/00 (2019.01); G06K 9/62 (2006.01);
U.S. Cl.
CPC ...
G01C 21/3453 (2013.01); G01C 21/3415 (2013.01); G06K 9/6262 (2013.01); G06N 20/00 (2019.01); G06Q 10/047 (2013.01);
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining routing using reinforcement learning (RL) are provided. One of the methods includes: initializing a state of an RL model based on a routing solution, wherein the RL model comprises a plurality of improvement actions for applying to the state; applying one or more of the plurality of improvement actions to the state to obtain updated routing solutions until a predetermined condition is satisfied; applying a perturbation action to obtain a perturbed routing solution and feeding the perturbed routing solution back to the RL model for the RL model to perform the applying one or more of the plurality of improvement actions according to the policy; and determining a routing solution with a minimum cost from the updated routing solutions.


Find Patent Forward Citations

Loading…