Tivo Solutions Inc.

Digitalsmiths Corporation

Tivo Corporation

Other

Matthew G Berry

Heather Dunlop

Schuyler Evar Eckstrom

Changwen Yang

Isaac Kunkel

Tim Jones

Benjamin J Weinberger

Liang Zhao

Albert L Segars

A system for using metadata from a video signal to associate advertisements therewith, comprising (i) a segmentation system to divide the video signal into video clips, (ii) a digitizing system for digitizing the video clips, (iii) a feature extraction system for extracting audio and video features from each video clip, associating each audio feature with respective video clips, associating each video feature with respective video clips, and saving the audio and video features into an associated metadata file, (iv) a web interface to the feature extraction system for receiving the video clips, and (v) a database, wherein video signals and associated metadata files are stored and indexed, wherein the associated metadata file is provided when a video player requests the corresponding video signal, enabling selection of a relevant advertisement for presentment in conjunction with respective video clips based on the associated audio and video features of the respective video clip.

Systems and methods for using video metadata to associate advertisements therewith

A system and method for navigating digital media assets including a navigation system configured to receive a search query in response to a user input and process the search query by applying the search query to a search index of digital media asset conventional and time-based metadata and determining search results of titles of and start points in time within digital media assets that satisfy the search query. The navigation system may then display the search results to the user through the user interface. The search results may be displayed in a hierarchical format, wherein the title of the digital media asset is displayed and upon selecting the title of the digital media asset, the start points in time within that digital media asset are displayed or played as a video to the user through the user interface.

User interface for viewing targeted segments of multimedia content based on time-based metadata search criteria

The present disclosure relates to systems and methods for dynamically creating hyperlinks associated with relevant multimedia content in a computer network. A hyperlink generation module receives an electronic text file from a server. The module searches the text file to identify keywords present in the file. Once the keywords have been identified, a database is queried to identify multimedia content that is related to the keywords. Generally, multimedia content is associated with metadata to enable efficient searching of the multimedia content. Typically, the multimedia content is contextually relevant to both the identified keywords and text file. One or more hyperlinks corresponding to the keywords are then generated and inserted into the text file. The hyperlinks provide pointers to the identified multimedia content. After insertion into the text file, the hyperlinks may be clicked by a user or viewer of the file to retrieve and display the identified multimedia content.

Systems and methods for dynamically creating hyperlinks associated with relevant multimedia content

Managing metadata associated with a digital media asset includes selecting the digital media asset, displaying the digital media asset in a filmstrip format that presents one or more scenes from the digital media asset along a timeline, wherein each scene corresponds with an underlying point in time along the timeline, and wherein the digital media asset has a start time and an end time that define the timeline, displaying at least one track in timeline alignment with the film strip format wherein the at least one track corresponds with a type of metadata associated with the digital media asset, and displaying on the at least one track, one or more segments, wherein each segment has a start point and an end point along the timeline and wherein each respective segment represents a span of time in which the type of metadata occurs within the digital media asset.

Time-based metadata management system for digital media

The present disclosure relates to systems and methods for classifying videos based on video content. For a given video file including a plurality of frames, a subset of frames is extracted for processing. Frames that are too dark, blurry, or otherwise poor classification candidates are discarded from the subset. Generally, material classification scores that describe type of material content likely included in each frame are calculated for the remaining frames in the subset. The material classification scores are used to generate material arrangement vectors that represent the spatial arrangement of material content in each frame. The material arrangement vectors are subsequently classified to generate a scene classification score vector for each frame. The scene classification results are averaged (or otherwise processed) across all frames in the subset to associate the video file with one or more predefined scene categories related to overall types of scene content of the video file.

Systems and methods for semantically classifying and normalizing shots in video

Systems and methods for semantically classifying and extracting shots in video

The addition of temporal positions to an inverted index allows for temporal queries in addition to phrase queries. Store additional binary data for each term instance in the word-level index to prepare for searching in response to time-based queries from a user is accomplished through the use of Lucene's binary payload feature where the payload structure is defined for use in such searches. The pre-defined payload fields consist of three integers, which account for 12 extra bytes that must be stored for each term instance. A content database on the Master/Administrator server node provides the indexes for search into content in response to user events, returning results in JSON format. The search results may then be used to locate and present content segments to a user containing both requested search term results and the time location and duration within a content asset where the search term(s) is found.

Timeline alignment and coordination for closed-caption text using speech recognition transcripts

Systems and methods are provided for generating unique signatures for digital video files to locate video sequences within a video file comprising calculating a frame signature for each frame of a first video; and for a second video: calculating a frame signature for each frame of the second video for corresponding first video frame signatures, calculating a frame distance between each of the corresponding video frame signatures, determining video signature similarity between the videos, and searching within a video signature similarity curve to determine a maximum corresponding to the first video within the second video. The method further applies area augmentation to the video signature similarity curve to determine a maximum from among a plurality of maxima corresponding to the first video file within the second video file.

Systems and methods for robust video signature with area augmented matching

The present disclosure relates to systems and methods for identifying advertisement breaks in digital video files. Generally, an advertisement break identification module receives a digital video file and generates an edge response for each of one or more frames extracted from the video file. If one of the generated edge responses for a particular frame is less than a predefined threshold, then the module identifies the particular frame as the start of an advertisement break. The module then generates further edge responses for frames subsequent to the identified particular frame. Once an edge response is generated for a particular subsequent frame that is greater than the threshold, it is identified as the end of the advertisement break. The video file may then be manipulated or transformed, such as by associating metadata with the advertisement break for a variety of uses, removing the advertisement break from the video file, etc. Optionally, various time and/or frame thresholds, as well as an audio verification process, are used to validate the identified advertisement break.

Systems and methods for identifying pre-inserted and/or potential advertisement breaks in a video sequence

Systems and methods for semantically classifying shots in video

Method, systems, and computer program products for synchronizing text with audio in a multimedia file, wherein the multimedia file is defined by a timeline having a start point and end point and respective points in time therebetween, wherein an N-gram analysis is used to compare each word of a closed-captioned text associated with the multimedia file with words generated by an automated speech recognition (ASR) analysis of the audio of the multimedia file to create an accurate, time-based metadata file in which each closed-captioned word is associated with a respective point on the timeline corresponding to the same point in time on the timeline in which the word is actually spoken in the audio and occurs within the video.

Growing community of inventors

Creedmoor, NC, United States of America

Matthew G Berry