The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 14, 2021

Filed:

Jan. 07, 2020
Applicant:

Huazhong University of Science and Technology, Hubei, CN;

Inventors:

Nong Sang, Hubei, CN;

Shiwei Zhang, Hubei, CN;

Zhiyuan Li, Hubei, CN;

Changxin Gao, Hubei, CN;

Yuanjie Shao, Hubei, CN;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06T 3/00 (2006.01); G06T 7/207 (2017.01); G06T 7/215 (2017.01); G06T 3/40 (2006.01);
U.S. Cl.
CPC ...
G06K 9/00718 (2013.01); G06K 9/00765 (2013.01); G06T 3/0087 (2013.01); G06T 3/4053 (2013.01); G06T 7/207 (2017.01); G06T 7/215 (2017.01); G06K 2209/21 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20072 (2013.01); G06T 2207/20076 (2013.01); G06T 2207/20164 (2013.01);
Abstract

A spatiotemporal action detection method includes performing object detection on all frames of a sample video to obtain a candidate object set; calculating all interframe optical flow information on the sample video to obtain a motion set; constructing a spatiotemporal convolution-deconvolution network of an attention mechanism and a motion attention mechanism of an additional object; adding both a corresponding sparse variable and a sparse constraint to obtain a network structure S after performing spatiotemporal convolution processing on each time segment of the sample video; training the network structure S with an objective function based on classification loss and loss of the sparse constraint of cross entropy; and calculating an action category and a sparse coefficient corresponding to each time segment of a test sampled video to obtain an object action spatiotemporal location.


Find Patent Forward Citations

Loading…