Gracenote, Inc.

Roku, Inc.

The Nielsen Comapny (us), LLC

Wilson Harron

Markus Kurt Cremer

Konstantinos Antonios Dimitriou

Steven D Scherf

Irene Zhu

David Henry Pearce

Sherman Ling Fung Li

Peter Dunker

Dewey Ho Lee

Oscar Celma Herrada

Matthew James Wilkinson

Cameron Aubrey Summers

Sherman Li

Kostantinos Dimitriou

A query fingerprint of a set of frames of video content captured at a client device may be generated. Multiple patches of the set of frames of video content may be selected and a value calculated for each of the selected multiple patches. The value for each patch may be indicated as a single bit along with an additional 1-bit value to indicate whether the patch value is weak. A database of known reference fingerprints may be queried using the generated query fingerprint. Matches between the query fingerprint and the reference fingerprints may be identified. Weak bits may be given reduced weight in identifying the match of fingerprints. Based on the matches, an identifier for the video content may be returned to the client device. The client device may use the received identifier to access the supplemental content.

Video fingerprinting

Example methods and systems for generating a video presentation to accompany audio are described. The video presentation to accompany the audio track is generated from one or more video sequences. In some example embodiments, the video sequences are divided into video segments that correspond to discontinuities between frames. Video segments are concatenated to form a video presentation to which the audio track is added. In some example embodiments, only video segments having a duration equal to an integral number of beats of music in the audio track are used to form the video presentation. In these example embodiments, transitions between video segments in the video presentation that accompanies the audio track are aligned with the beats of the music.

Generating a video presentation to accompany audio

In one aspect, an example method includes a processor (1) applying a feature map network to an image to create a feature map comprising a grid of vectors characterizing at least one feature in the image and (2) applying a probability map network to the feature map to create a probability map assigning a probability to the at least one feature in the image, where the assigned probability corresponds to a likelihood that the at least one feature is an overlay. The method further includes the processor determining that the probability exceeds a threshold, and responsive to the processor determining that the probability exceeds the threshold, performing a processing action associated with the at least one feature.

Recurrent deep neural network system for detecting overlays in images

A client device accesses a video input stream from an intermediate device for display. The client device analyzes the video input stream to determine that the video input stream matches a template corresponding to a screen portion. Based on the video input stream matching the template, a video output stream is generated and caused to be presented on a display. In some example embodiments, the analysis is performed while the client device is replacing video content received from a content source via the intermediate device. For example, commercials transmitted from a national content provider to a smart TV via a set-top box may be replaced with targeted commercials. During the replacement, menus generated by the set-top box may be detected and the replacement video altered by the smart TV to include the menus.

Dynamic video overlays

In one aspect, an example method includes receiving, by a computing system, media content; generating, by the computing system, a fingerprint of the received media content; determining, by the computing system, that a channel-change operation was performed; responsive to determining that the channel-change operation was performed, transmitting, by the computing system, the generated fingerprint to a content identification server to identify the received media content; and performing an action based on the identified media content.

Computing system with channel-change-based trigger feature

Techniques of providing an interactive programming guide with a personalized lineup are disclosed. In some embodiments, a profile is accessed, and a personalized lineup is determined based on the profile. The personalized lineup may include a corresponding media content identification assigned to each one of a plurality of sequential time slots, where each media content identification identifies media content for the corresponding time slot. A first interactive programming guide may be caused to be displayed on a first media content device associated with the profile, where the first interactive programming guide includes the personalized lineup.

Interactive programming guide

Methods and systems to identify video content based on video fingerprint matching are described. In some example embodiments, the methods and systems generate a query fingerprint of a frame of video content captured at a client device, query a database of reference fingerprints, determine the query fingerprint of the frame of captured video content matches a reference fingerprint, and identify the video content based on the match of fingerprints.

Identifying video content via fingerprint matching

In one aspect, an example method includes (i) receiving, by a computing system, media content; (ii) generating, by the computing system, a fingerprint of the received media content; (iii) determining, by the computing system, that a channel-change operation was performed; (iv) responsive to determining that the channel-change operation was performed, transmitting, by the computing system, the generated fingerprint to a content identification server to identify the received media content; and (v) performing an action based on the identified media content.

In one aspect, an example method includes (i) receiving, by a computing system, media content; (ii) generating, by the computing system, a fingerprint of a portion of the received media content; (iii) determining, by the computing system, that the received media content has a predefined characteristic; (iv) responsive to determining that the received media content has the predefined characteristic, transmitting, by the computing system, the generated fingerprint to a content identification server to identify the portion of the received media content; and (v) performing an action based on the identified portion of media content.

Growing community of inventors

Berkeley, CA, United States of America

Wilson Harron