The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jun. 09, 2020
Filed:
Dec. 12, 2019
Alibaba Group Holding Limited, George Town, KY;
Alibaba Group Holding Limited, George Town, Grand Cayman, KY;
Abstract
Disclosed herein are methods, systems, and apparatus for generating an action selection policy for a software-implemented application that performs actions in an environment that includes an execution device supported by the application and one or more other devices. One method includes, for each action among possible actions in a state of the execution device in a current iteration, obtaining a regret value of the action in the state of the execution device in a previous iteration; and computing a parameterized regret value of the action in the state of the execution device in the previous iteration; determining a respective normalized regret value for each of the possible actions in the previous iteration; determining, from the normalized regret values, an action selection policy of the action in the state of the execution device; and controlling operations of the execution device according to the action selection policy.