The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 02, 2020

Filed:

Jul. 03, 2017
Applicant:

Baidu Usa Llc, Sunnyvale, CA (US);

Inventors:

Yu Huang, Sunnyvale, CA (US);

Hsien-Ting Cheng, Sunnyvale, CA (US);

Jun Zhu, Sunnyvale, CA (US);

Weide Zhang, Sunnyvale, CA (US);

Assignee:

BAIDU USA LLC, Sunnyvale, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G05D 1/02 (2020.01); H04N 7/18 (2006.01); H04N 5/232 (2006.01); G06T 3/40 (2006.01); G06T 7/55 (2017.01); G06T 7/521 (2017.01); G06T 11/60 (2006.01); G05D 1/00 (2006.01); G01S 17/89 (2020.01); G06N 3/04 (2006.01); G01S 7/48 (2006.01); H04N 13/128 (2018.01); H04N 13/271 (2018.01); H04N 13/254 (2018.01); H04N 13/00 (2018.01); G06T 5/50 (2006.01); G06T 5/00 (2006.01); H04N 5/225 (2006.01); G06N 7/00 (2006.01); G01S 17/86 (2020.01); G01S 17/931 (2020.01); G06N 3/08 (2006.01);
U.S. Cl.
CPC ...
G05D 1/0251 (2013.01); G01S 7/4808 (2013.01); G01S 17/86 (2020.01); G01S 17/89 (2013.01); G01S 17/931 (2020.01); G05D 1/00 (2013.01); G05D 1/0088 (2013.01); G06N 3/04 (2013.01); G06N 3/0454 (2013.01); G06N 7/005 (2013.01); G06T 3/40 (2013.01); G06T 3/4046 (2013.01); G06T 5/003 (2013.01); G06T 5/50 (2013.01); G06T 7/521 (2017.01); G06T 7/55 (2017.01); G06T 11/60 (2013.01); H04N 5/2258 (2013.01); H04N 5/23238 (2013.01); H04N 7/181 (2013.01); H04N 13/00 (2013.01); H04N 13/128 (2018.05); H04N 13/254 (2018.05); H04N 13/271 (2018.05); G06N 3/0445 (2013.01); G06N 3/0481 (2013.01); G06N 3/082 (2013.01); G06N 3/088 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30252 (2013.01);
Abstract

In one embodiment, a method or system generates a high resolution 3-D point cloud to operate an autonomous driving vehicle (ADV) from a low resolution 3-D point cloud and camera-captured image(s). The system receives a first image captured by a camera for a driving environment. The system receives a second image representing a first depth map of a first point cloud corresponding to the driving environment. The system determines a second depth map by applying a convolutional neural network model to the first image. The system generates a third depth map by applying a conditional random fields model to the first image, the second image and the second depth map, the third depth map having a higher resolution than the first depth map such that the third depth map represents a second point cloud perceiving the driving environment surrounding the ADV.


Find Patent Forward Citations

Loading…