The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 12, 2020

Filed:

Jun. 28, 2018
Applicants:

Huy Tho Ho, San Jose, CA (US);

Jingwei Wang, San Jose, CA (US);

Kjell Fredrik Larsson, San Jose, CA (US);

Inventors:

Huy Tho Ho, San Jose, CA (US);

Jingwei Wang, San Jose, CA (US);

Kjell Fredrik Larsson, San Jose, CA (US);

Assignee:

Apple Inc., Cupertino, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/62 (2006.01); G06T 7/11 (2017.01); G06K 9/00 (2006.01);
U.S. Cl.
CPC ...
G06K 9/6256 (2013.01); G06K 9/00201 (2013.01); G06T 7/11 (2017.01); G06T 2207/10028 (2013.01);
Abstract

Systems and methods for semantic labeling of point clouds using images. Some implementations may include obtaining a point cloud that is based on lidar data reflecting one or more objects in a space; obtaining an image that includes a view of at least one of the one or more objects in the space; determining a projection of points from the point cloud onto the image; generating, using the projection, an augmented image that includes one or more channels of data from the point cloud and one or more channels of data from the image; inputting the augmented image to a two dimensional convolutional neural network to obtain a semantic labeled image wherein elements of the semantic labeled image include respective predictions; and mapping, by reversing the projection, predictions of the semantic labeled image to respective points of the point cloud to obtain a semantic labeled point cloud.


Find Patent Forward Citations

Loading…