The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 29, 2020

Filed:

Dec. 12, 2019
Applicant:

Alibaba Group Holding Limited, George Town, KY;

Inventors:

Hui Li, Hangzhou, CN;

Kailiang Hu, Hangzhou, CN;

Le Song, Hangzhou, CN;

Assignee:

Alibaba Group Holding Limited, George Town, Grand Cayman, KY;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
A63F 3/00 (2006.01); G07F 17/32 (2006.01);
U.S. Cl.
CPC ...
G07F 17/3262 (2013.01); G07F 17/3241 (2013.01); G07F 17/3293 (2013.01);
Abstract

Disclosed herein are methods, systems, and apparatus for generating an action selection policy (ASP) of an execution device. One method includes, in a current iteration, computing a first reward for a current state based on respective first rewards for actions in the current state and an ASP of the current state in the current iteration; computing an accumulative respective regret value of each action in the current state based on a difference between the respective first reward for the action and the first reward for the current state; computing an ASP of the current state in the next iteration; computing a second reward for the current state based on the respective first rewards for the actions and the ASP of the current state in the next iteration; and determining an ASP of the previous state in the next iteration based on the second reward for the current state.


Find Patent Forward Citations

Loading…