The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 20, 2020

Filed:

May. 17, 2019
Applicant:

Samsung Electronics Co., Ltd., Suwon-si, Gyeonggi-do, KR;

Inventors:

Michael Sapienza, Mountain View, CA (US);

Ankur Gupta, Santa Clara, CA (US);

Abhijit Bendale, Sunnyvale, CA (US);

Fannie Fontanel, Mountain View, CA (US);

Assignee:
Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
H04N 5/232 (2006.01); H04N 5/343 (2011.01); G02B 27/01 (2006.01); H04N 5/357 (2011.01); H04N 5/374 (2011.01); G06T 7/11 (2017.01); G06K 9/62 (2006.01); G06T 15/00 (2011.01); G06T 15/10 (2011.01); G06T 19/00 (2011.01);
U.S. Cl.
CPC ...
H04N 5/23241 (2013.01); G02B 27/017 (2013.01); G06K 9/628 (2013.01); G06T 7/11 (2017.01); G06T 15/005 (2013.01); G06T 15/10 (2013.01); G06T 19/006 (2013.01); H04N 5/2327 (2013.01); H04N 5/343 (2013.01); H04N 5/357 (2013.01); H04N 5/374 (2013.01); H04N 5/3741 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20084 (2013.01); G06T 2210/12 (2013.01);
Abstract

An apparatus includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, a CMOS image sensor configured to output frames of image data, an inertial measurement unit (IMU), a processor and a memory. The memory contains instructions, which when executed by the processor, cause the apparatus to generate a semantic segmentation of a time-stamped frame, which is based on one or more of an output of the CMOS image sensor, or a synthesized event frame based on an output from the DVS and an output from the IMU over a time interval. The semantic segmentation includes a semantic label associated with a region of the time-stamped frame. When executed, the instructions further cause the apparatus to determine, based on the semantic segmentation, a simplified object representation in a coordinate space, and update a stable semantic map based on the simplified object representation.


Find Patent Forward Citations

Loading…