The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 25, 2019

Filed:

Sep. 20, 2017
Applicant:

Nec Laboratories America, Inc., Princeton, NJ (US);

Inventors:

Muhammad Zeeshan Zia, San Jose, CA (US);

Quoc-Huy Tran, Santa Clara, CA (US);

Xiang Yu, Mountain View, CA (US);

Manmohan Chandraker, Santa Clara, CA (US);

Chi Li, San Jose, CA (US);

Assignee:

NEC Corporation, Tokyo, JP;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06K 9/62 (2006.01); G06F 17/50 (2006.01); G06N 3/02 (2006.01); G06T 11/60 (2006.01); G06T 15/40 (2011.01); G05D 1/02 (2006.01); G08G 1/16 (2006.01); G06T 7/73 (2017.01); G06N 3/08 (2006.01); G06T 15/10 (2011.01); B60W 30/00 (2006.01); G08G 1/0962 (2006.01); G06T 7/55 (2017.01); G06K 9/46 (2006.01);
U.S. Cl.
CPC ...
G06K 9/6256 (2013.01); B60W 30/00 (2013.01); G05D 1/0221 (2013.01); G06F 17/5009 (2013.01); G06K 9/00201 (2013.01); G06K 9/00208 (2013.01); G06K 9/00624 (2013.01); G06K 9/00771 (2013.01); G06K 9/00805 (2013.01); G06K 9/6255 (2013.01); G06N 3/02 (2013.01); G06N 3/084 (2013.01); G06T 7/74 (2017.01); G06T 11/60 (2013.01); G06T 15/10 (2013.01); G06T 15/40 (2013.01); G08G 1/0962 (2013.01); G08G 1/166 (2013.01); B60T 2201/022 (2013.01); G06K 9/4628 (2013.01); G06T 7/55 (2017.01); G06T 2207/20101 (2013.01); G06T 2207/30261 (2013.01); G06T 2210/22 (2013.01);
Abstract

An action recognition system and method are provided. The action recognition system includes an image capture device configured to capture an actual image depicting an object. The action recognition system includes a processor configured to render, based on a set of 3D CAD models, synthetic images with corresponding intermediate shape concept labels. The processor is configured to form a multi-layer CNN which jointly models multiple intermediate shape concepts, based on the rendered synthetic images. The processor is configured to perform an intra-class appearance variation-aware and occlusion-aware 3D object parsing on the actual image by applying the CNN thereto to generate an image pair including a 2D and 3D geometric structure of the object. The processor is configured to control a device to perform a response action in response to an identification of an action performed by the object, wherein the identification of the action is based on the image pair.


Find Patent Forward Citations

Loading…