Roku, Inc.

The Nielsen Comapny (us), LLC

Sorenson Media, Inc.

Steven Michael Cormie

Andrew Laurence Ashbacher

Stefanos Christakis Liassides

Stefan Liassides

John L Haynes, Iii

Brian Patrick Jentz

Shashank C Merchant

Matthew George Grover

Markus Kurt Peter Cremer

Stefan Matthijs Maris

Joel Michael Curl

Benjamin J Ropke

Andreas Schmidt

John Steven Stavropoulos

Matthew Simon Pearce

Use of watermarking in a media stream as a trigger for carrying out a fingerprint-related action, such as starting to generate fingerprints of the media stream, increasing a rate of generation of fingerprints of the media stream, starting to report fingerprints of the media stream, requesting fingerprints, or engaging in a fingerprint comparison. In an implementation, a media client that is processing the media stream could detect the watermark in the media stream and could responsively carry out or cause to be carried out a fingerprint-related action. Or an entity in a media-distribution path along which the media stream flows to a media client could detect the watermark in the media stream and could responsively carry out or cause to be carried out a fingerprint-related action. Further, the watermark could be inserted into the media stream in the first place based on transport-stream carried metadata, among other possibilities.

Use of watermarking to trigger fingerprint-related action

In one aspect, a method includes identifying an upcoming content-modification opportunity on a channel, where the upcoming content-modification opportunity relates to a modifiable content-segment transmitted by a content-distribution system on the channel, and where the modifiable content-segment includes an overlay content portion and a non-overlay content portion. The method also includes responsive to identifying the upcoming content-modification opportunity on the channel, identifying a content-presentation device tuned to the channel. The method also includes determining location data associated with the overlay content portion. The method also includes transmitting, to the identified content-presentation device, the determined location data to facilitate the content-presentation device performing a content-modification operation in connection with the identified upcoming content-modification opportunity on the channel, where performing the content-modification operation involves replacing only the non-overlay content portion with supplemental content.

Content-modification system with overlay handling feature

In a communication system where a channel teed carrying a media stream is broadcast for delivery of the media stream to a media client, where the channel feed further includes metadata in-band and correlated with a content frame of the media stream, but where the metadata gets removed from the channel feed before the media stream reaches the media client, a computing system (i) extracts the metadata from the channel feed and (ii) transmits out-of-band to the media client the extracted metadata in correlation with reference fingerprint data representing the frame of the media stream, the correlation being useable by the media client as a basis to re-correlate the metadata with the frame of the media stream, so as to enable the media client to carry out an action, such as dynamic ad insertion, based on the correlation of the metadata with the frame of the media stream.

Method and system for re-uniting metadata with media-stream content at a media client, to facilitate action by the media client

In one aspect, a method is disclosed for use with a content-presentation device that is scheduled to perform a first content-modification operation that comprises modifying a modifiable content-segment received by the content-presentation device. The method includes determining that the content-presentation device is unable to perform the first content-modification operation as scheduled. The method also includes responsive to the determining, performing an action that facilitates the content-presentation device performing a second content-modification operation instead of performing the first content-modification operation, where performing the second content-modification operation involves modifying the modifiable content-segment in a different way as compared to the first content-modification operation.

Content-modification system with issue detection and responsive action feature

In one aspect, a method includes receiving query fingerprint data representing content received by a content-presentation device. The method also includes identifying a geographic area of the content-presentation device. The method also includes using at least the identified geographic area as a basis to select, from among a plurality of reference fingerprint data sets, a reference fingerprint data set that corresponds with the identified geographic area. The method also includes detecting a match between the query fingerprint data and at least a portion of reference fingerprint data in the selected reference fingerprint data set. The method also includes responsive to detecting the match, performing an action.

Content-modification system with geographic area-based feature

As a media client receives a media stream for presentation, the media client could receive, in-band with the media stream, metadata identifying the media stream, such as a media-stream identifier encoded as a watermark in the media stream or carried together with the media stream in a packet-based transport stream, among other possibilities. And while the media client is processing the media stream for presentation, the media client could then convey the received metadata out-of-band to a server to enable the server to readily obtain reference fingerprints representing the media stream and to thereby facilitate, based on the reference fingerprints, a content-related action such as dynamic content modification for instance.

Use of in-band metadata as basis to access reference fingerprints to facilitate content-related action

In one aspect, a method includes identifying a group of multiple content-presentation devices that are tuned to the same channel and that are each scheduled to perform, at a modification start-time, a respective content-modification operation that comprises modifying a modifiable content-segment in connection with an upcoming content-modification opportunity on the channel. The method also includes determining that, after the modification start-time, at least a subgroup of the group of content-presentation devices have detected a mismatch between reference fingerprint data representing the modifiable content-segment and query fingerprint data representing content received by at least the subgroup of content-presentation devices. The method also includes determining that at least the subgroup of content-presentation devices are connected to tuner devices associated with the same content distributor and, in response to determining that at least the subgroup of content-presentation devices are connected to tuner devices associated with the same content distributor, performing an action.

Content-modification system with feature for detecting and responding to content modifications by tuner devices

In one aspect, a method includes receiving first query fingerprint data representing first content channeled through a portion of a content-distribution system. The method also includes detecting a first match between the received first query fingerprint data and first reference fingerprint data representing a modifiable content-segment. The method also includes responsive to detecting the first match, performing a first action. The method also includes receiving second query fingerprint data representing content received by a content-presentation device. The method also includes detecting a second match between the received second query fingerprint data and second reference fingerprint data representing second content transmitted by the content-distribution system, where the second content is a modified version of the first content. The method also includes responsive to detecting the second match, performing a second action that is different from the first action.

Content-modification system with use of multiple fingerprint data types feature

In one aspect, a method is for use in connection with a content-modification system that includes a content-distribution system and a content-presentation device. The method includes (i) identifying an upcoming content modification opportunity on an identified channel, wherein the identifying is based on detecting a match between first reference fingerprint data representing an initial portion of a modifiable content-segment and query fingerprint data representing content transmitted by a content-distribution system to a content-presentation device, wherein the first reference fingerprint data was generated before the query fingerprint data was generated; and (ii) responsive to identifying the upcoming content modification opportunity, transmitting to the content-presentation device, second reference fingerprint data representing more than the initial portion of the modifiable content-segment to facilitate the content-presentation device to, at a later time, abort performance of a partially performed content-modification operation related to the identified content modification opportunity.

Content-modification system with responsive transmission of reference fingerprint data feature

In a communication system where a channel feed carrying a media stream is broadcast for delivery of the media stream to a media client, where the channel feed further includes metadata in-band and correlated with a content frame of the media stream, but where the metadata gets removed from the channel feed before the media stream reaches the media client, a computing system (i) extracts the metadata from the channel feed and (ii) transmits out-of-band to the media client the extracted metadata in correlation with reference fingerprint data representing the frame of the media stream, the correlation being useable by the media client as a basis to re-correlate the metadata with the frame of the media stream, so as to enable the media client to carry out an action, such as dynamic ad insertion, based on the correlation of the metadata with the frame of the media stream.

In one aspect, a method includes receiving query fingerprint data representing content received by a content-presentation device. The method also includes comparing at least a first portion of the query fingerprint data with at least one first reference fingerprint data set, where each first reference fingerprint data set corresponds with a respective channel. The method also includes determining that the query fingerprint data does not match any of the at least one first reference fingerprint data sets. The method also includes responsive to the determining, comparing at least a second portion of the query fingerprint data with second reference fingerprint data representing a modifiable content-segment. The method also includes detecting a match between at least the second portion of the query fingerprint data and the second reference fingerprint data. The method also includes responsive to detecting the match, performing an action that facilitates the content-presentation device performing a content-modification operation.

Content-modification system with fingerprint data mismatch and responsive action feature

In one aspect, a method is for use in connection with a content-modification system that includes a content-distribution system and a content-presentation device. The method includes (i) identifying an upcoming content modification opportunity on an identified channel, wherein the identifying is based on detecting a match between first reference fingerprint data representing an initial portion of a modifiable content-segment and query fingerprint data representing content transmitted by a content-distribution system to a content-presentation device, wherein the first reference fingerprint data was generated before the query fingerprint data was generated; and (ii) responsive to identifying the upcoming content modification opportunity, transmitting to the content-presentation device, second reference fingerprint data representing more than the initial portion of the modifiable content-segment to facilitate the content-presentation device to, at a later time, continue performing a content-modification operation related to the identified content modification opportunity.

In one aspect, a method includes receiving first content at a content-presentation device and presenting the first content, the first content comprising a first audio-content component. The content-presentation device may receive second content comprising a second audio-content component. The content-presentation device may determine a switch time at which to switch from presenting the first content to presenting the second content. During a first time interval prior to the switch time and ending at the switch time, the volume of the first audio-content component may be decreased to zero. At the switch time, the content-presentation device may switch from presenting the first content to presenting the second content. During a second time interval beginning at the switch time and ending at a second time after the switch time, the volume of the second audio-content component may be increased from zero to a non-zero volume level.

Growing community of inventors

Cambridge, United Kingdom

Steven Michael Cormie