The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 18, 2020

Filed:

Dec. 19, 2016
Applicant:

Futurewei Technologies, Inc., Plano, TX (US);

Inventors:

Wei Jiang, Santa Clara, CA (US);

Wei Wang, Santa Clara, CA (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2006.01); G06N 3/04 (2006.01); B25J 9/16 (2006.01); G06N 7/00 (2006.01); G06N 3/00 (2006.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01); B25J 9/163 (2013.01); G06N 3/008 (2013.01); G06N 7/005 (2013.01); G06N 3/0454 (2013.01); Y10S 901/47 (2013.01);
Abstract

A robotic device is disclose as having deep reinforcement learning capability. The device includes non-transitory memory comprising instructions and one or more processors in communication with the memory. The instructions cause the one or more processors to receive a sensing frame, from a sensor, comprising an image. The processors then determine a movement transition based on the sensing frame and the deep reinforcement learning, wherein the deep reinforcement learning uses at least one of a map coverage reward, a map quality reward, or a traversability reward to determine the movement transition. The processors then update an area map based on the sensing frame and the deep reinforcement learning using a visual simultaneous localization and mapping (SLAM) process to determine the map updates.


Find Patent Forward Citations

Loading…