The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 30, 2020

Filed:

Jan. 12, 2018
Applicant:

Futurewei Technologies, Inc., Plano, TX (US);

Inventors:

Wei Jiang, Santa Clara, CA (US);

Wei Wang, Santa Clara, CA (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
B25J 9/16 (2006.01); B25J 19/02 (2006.01); B25J 11/00 (2006.01); B25J 13/08 (2006.01); G05D 1/02 (2020.01); G05D 3/20 (2006.01);
U.S. Cl.
CPC ...
B25J 9/1697 (2013.01); B25J 11/008 (2013.01); B25J 13/08 (2013.01); B25J 19/023 (2013.01); G05D 1/0246 (2013.01); G05D 3/20 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/30241 (2013.01);
Abstract

A system and method of tracking an object and navigating an object tracking robot includes receiving tracking sensor input representing the object and an environment at multiple times, responsive to the tracking sensor input, calculating positions of the robot and the object at the multiple times, and using a computer implemented deep reinforcement learning (DRL) network trained as a function of tracking quality rewards and robot navigation path quality rewards, the DRL network being responsive to the calculated positions of the robot and the object at the multiple times to determine possible actions specifying movement of the object tracking robot from a current position of the robot and target, determine quality values (Q-values) for the possible actions, and select an action as a function of the Q-values. A method of training the DRL network is also included.


Find Patent Forward Citations

Loading…