The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Nov. 17, 2020
Filed:
Nov. 14, 2019
Fudan University, Shanghai, CN;
Yugang Jiang, Shanghai, CN;
Shaoxiang Chen, Shanghai, CN;
FUDAN UNIVERSITY, Shanghai, CN;
Abstract
A system for activity localization in videos is described, comprising a visual concept detection module, which produces a plurality of first visual concept vectors each representing a probability of containing visual concepts for one of a plurality of sampled frames sampled from an input video; wherein each of the plurality of first visual concept vectors dot-product with a second visual concept vector extracted from a given query sentence, resulting a visual-semantic correlation score; a semantic activity proposal generation module, which generates semantic activity proposals by temporally grouping frames with a high visual-semantic correlation score; and a proposal evaluation and refinement module, which takes the semantic activity proposals, the visual concept vectors and the query sentence as input, and outputs alignment scores and refined boundaries for the proposals. The disclosure also relates to methods thereof.