The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 25, 2023

Filed:

Jun. 28, 2021
Applicant:

Apple Inc., Cupertino, CA (US);

Inventors:

Behrooz Mahasseni, San Jose, CA (US);

Mark Drummond, Palo Alto, CA (US);

Assignee:

Other;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06T 19/00 (2011.01); G06N 20/00 (2019.01); G06T 13/40 (2011.01); G06N 3/08 (2023.01); G06F 3/16 (2006.01);
U.S. Cl.
CPC ...
G06N 20/00 (2019.01); G06N 3/08 (2013.01); G06T 13/40 (2013.01); G06T 19/006 (2013.01); G06F 3/167 (2013.01); G06T 2200/24 (2013.01);
Abstract

In one implementation, a method for inverse reinforcement learning for tailoring virtual agent behaviors to a specific user. The method includes: obtaining an initial behavior model for a virtual agent and an initial state for a virtual environment associated with the virtual agent, wherein the initial behavior model includes one or more tunable parameters; generating, based on the initial behavior model and the initial state for the virtual environment, a first set of behavioral trajectories for the virtual agent; obtaining a second set of behavioral trajectories from a source different from the initial behavior model; and generating an updated behavior model by adjusting at least one of the one or more tunable parameters of the initial behavior model as a function of the first and second sets of behavioral trajectories, wherein at least one of the first and second sets of behavioral trajectories are assigned different weights.


Find Patent Forward Citations

Loading…