Other

Digitalsmiths Corporation

Changwen Yang

Matthew G Berry

The addition of temporal positions to an inverted index allows for temporal queries in addition to phrase queries. Store additional binary data for each term instance in the word-level index to prepare for searching in response to time-based queries from a user is accomplished through the use of Lucene's binary payload feature where the payload structure is defined for use in such searches. The pre-defined payload fields consist of three integers, which account for 12 extra bytes that must be stored for each term instance. A content database on the Master/Administrator server node provides the indexes for search into content in response to user events, returning results in JSON format. The search results may then be used to locate and present content segments to a user containing both requested search term results and the time location and duration within a content asset where the search term(s) is found.

Timeline alignment and coordination for closed-caption text using speech recognition transcripts

Method, systems, and computer program products for synchronizing text with audio in a multimedia file, wherein the multimedia file is defined by a timeline having a start point and end point and respective points in time therebetween, wherein an N-gram analysis is used to compare each word of a closed-captioned text associated with the multimedia file with words generated by an automated speech recognition (ASR) analysis of the audio of the multimedia file to create an accurate, time-based metadata file in which each closed-captioned word is associated with a respective point on the timeline corresponding to the same point in time on the timeline in which the word is actually spoken in the audio and occurs within the video.

Growing community of inventors

Morrisville, NC, United States of America

Changwen Yang