The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Oct. 12, 2021
Filed:
Oct. 29, 2020
Alipay (Hangzhou) Information Technology Co., Ltd., Zhejiang, CN;
Alipay (Hangzhou) Information Technology Co., Ltd., Zhejiang, CN;
Abstract
Disclosed herein are methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating an action selection policy of an execution device for completing a task in an environment. The method includes computing a hybrid sampling policy at a state of the execution device based on a sampling policy and an exploration policy, wherein the exploration policy specifies a respective exploration probability corresponding to each of multiple possible actions in the state, wherein the exploration probability is negatively correlated with a number of times that the each of the multiple possible actions in the state has been sampled; sampling an action among the multiple possible actions in the state according to a sampling probability of the action specified in the hybrid sampling policy; and updating an action selection policy in the state by performing Monte Carlo counterfactual regret minimization based on the action.