logo

For the Inventor, By the Inventor

The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 10743085 B1

PDFFull Text
Date of Patent:
Aug. 11, 2020

Filed:

Jul. 21, 2017

Automatic annotation of audio-video sequences

Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Akshay Prabhu, Hyderabad, IN;

Vasanth Raja Chittampally, Hyderabad, IN;

Assignee:

Microsoft Technology Licensing, LLC, Redmond, WA (US);

Attorney:

Klarquist Sparkman, LLP

Primary Examiner:

Eileen M Adams

Assistant Examiner:

Daniel T Tekle

Int. Cl.
CPC ...
H04N 21/81 (2011.01); G06K 9/00 (2006.01); G10L 15/26 (2006.01); G06F 40/169 (2020.01); G06F 16/951 (2019.01); G06F 16/248 (2019.01); G10L 21/055 (2013.01); G11B 27/10 (2006.01); H04N 5/93 (2006.01); H04N 21/231 (2011.01); H04N 21/234 (2011.01); H04N 21/43 (2011.01); H04N 21/488 (2011.01); H04N 21/8547 (2011.01); G10L 15/24 (2013.01);
U.S. Cl.
CPC ...
H04N 21/8133 (2013.01); G06F 16/248 (2019.01); G06F 16/951 (2019.01); G06F 40/169 (2020.01); G06K 9/00288 (2013.01); G06K 9/00523 (2013.01); G06K 9/00536 (2013.01); G06K 9/00671 (2013.01); G06K 9/00744 (2013.01); G10L 15/26 (2013.01); G10L 15/265 (2013.01); G10L 21/055 (2013.01); G11B 27/10 (2013.01); H04N 5/9305 (2013.01); H04N 21/23106 (2013.01); H04N 21/23418 (2013.01); H04N 21/4307 (2013.01); H04N 21/4884 (2013.01); H04N 21/8547 (2013.01); G10L 15/24 (2013.01);
Abstract

In some examples, a facility augments an audio-video sequence playback display with respect to a current playback position of the audio-video sequence within a time index range of the sequence. For a first portion of the time index range of the sequence containing the current playback position ('CPP'), the facility performs automatic voice transcription against the audio component to obtain speech text for at least one speaker. For a second portion of the time index range of the sequence containing the CPP, the facility performs automatic image recognition against the video component to obtain identifying information identifying at least one person, object, or location. Simultaneously with the sequence playback display and proximate to the sequence playback display, the facility displays one or more annotations each based upon (a) at least a portion of the obtained speech text, (b) at least a portion of the obtained identifying information, or (c) both.

Find Patent Forward Citations

Prabhu, Akshay. (2020). Automatic annotation of audio-video sequences (U.S. Patent No. 10743085). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/10743085

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…