The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 16, 2024

Filed:

May. 25, 2021
Applicant:

Fanuc Corporation, Yamanashi, JP;

Inventors:

Te Tang, Fremont, CA (US);

Tetsuaki Kato, Fremont, CA (US);

Assignee:

FANUC CORPORATION, Yamanashi, JP;

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
B25J 9/16 (2006.01); G06N 3/08 (2023.01); G06T 7/10 (2017.01); G06T 7/70 (2017.01); H04N 13/239 (2018.01);
U.S. Cl.
CPC ...
B25J 9/1669 (2013.01); B25J 9/1697 (2013.01); G06N 3/08 (2013.01); G06T 7/10 (2017.01); G06T 7/70 (2017.01); H04N 13/239 (2018.05); G06T 2207/10012 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01);
Abstract

A system and method identifying an object, such as a transparent object, to be picked up by a robot from a bin of objects. The method includes obtaining a 2D red-green-blue (RGB) color image and a 2D depth map image of the objects using a 3D camera, where pixels in the depth map image are assigned a value identifying the distance from the camera to the objects. The method generates a segmentation image of the objects using a deep learning mask R-CNN (convolutional neural network) that performs an image segmentation process that extracts features from the RGB image and assigns a label to the pixels so that objects in the segmentation image have the same label. The method then identifies a location for picking up the object using the segmentation image and the depth map image.


Find Patent Forward Citations

Loading…