The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Dec. 31, 2024

Filed:

Oct. 15, 2021
Applicant:

Fanuc Corporation, Yamanashi, JP;

Inventors:

Kaimeng Wang, Fremont, CA (US);

Tetsuaki Kato, Fremont, CA (US);

Assignee:

FANUC CORPORATION, Yamanashi, JP;

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
B25J 9/00 (2006.01); B25J 9/16 (2006.01); B25J 19/02 (2006.01); G06N 3/02 (2006.01); G06T 5/70 (2024.01); G06T 7/13 (2017.01); G06T 7/70 (2017.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01);
U.S. Cl.
CPC ...
B25J 9/0081 (2013.01); B25J 9/1612 (2013.01); B25J 19/023 (2013.01); G06N 3/02 (2013.01); G06T 5/70 (2024.01); G06T 7/13 (2017.01); G06T 7/70 (2017.01); G06V 40/107 (2022.01); G06V 40/28 (2022.01); G06T 2207/10028 (2013.01); G06T 2207/20021 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20132 (2013.01);
Abstract

A method for dual arm robot teaching from dual hand detection in human demonstration. A camera image of the demonstrator's hands and workpieces is provided to a first neural network which determines the identity of the left and right hand from the image, and also provides cropped sub-images of the identified hands. The cropped sub-images are provided to a second neural network which detects the poses of both the left and right hand from the images. The dual hand pose data for an entire operation is converted to robot gripper pose data and used for teaching two robot arms to perform the operation on the workpieces, where each hand's motion is assigned to one robot arm. Edge detection from camera images may be used to refine robot motions in order to improve part localization for tasks requiring precision, such as inserting a part into an aperture.


Find Patent Forward Citations

Loading…