The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 25, 2025

Filed:

Mar. 26, 2024
Applicant:

Mitsubishi Electric Research Laboratories, Inc., Cambridge, MA (US);

Inventors:

Devesh Jha, Cambridge, MA (US);

Shivam Vats, Pittsburg, PA (US);

Diego Romeres, Cambridge, MA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
B25J 9/16 (2006.01);
U.S. Cl.
CPC ...
B25J 9/161 (2013.01); B25J 9/163 (2013.01); B25J 9/1697 (2013.01);
Abstract

A feedback controller for controlling a robotic manipulator to perform a task is provided. The feedback controller comprises a memory configured to store a hierarchical reinforcement learning (HRL) neural network including (i) nominal control policy, and (ii) recovery control policy. The recovery control policy is trained based on a recovery policy reward to select a switch-to-nominal action to transfer control to the nominal control policy to perform the task. The recovery policy reward is dependent on a nominal policy reward for training the nominal control policy. The feedback controller further comprises a processor configured to iteratively execute the HRL neural network to select at least one of a nominal action based on the nominal control policy, and a recovery action based on the recovery control policy and to control the robotic manipulator to perform the task based on the selected action.


Find Patent Forward Citations

Loading…