Alphonso Inc.

Ashish Chordia

Lampros Kalampoukas

Raghu Srinivas Kodige

Zhengxiang Pan

Nikhil Sahasrabudhe

A method and system are provided for assigning metadata candidates to a commercial by performing image analysis on a plurality of the video frames to identify video frames that include one or more of identifiable product-related logos, brand-related logos, product-related text, or brand-related text which appear in the video frames, capturing frame data for such video frames, categorizing a temporal position of the identified video frames within the commercial as being in either a beginning or ending portion of the commercial, or a middle portion of the commercial, and assigning to the commercial the identified products or brands as primary metadata candidates when the temporal position of the identified video frames within the commercial is in either the beginning or ending portion of the commercial.

Automoted identification of product or brand-related metadata candidates for a commercial using temporal position of product or brand-related text or objects, or the temporal position and audio, in video frames of the commercial

A method and system are provided for assigning metadata candidates to a commercial by performing image analysis on a plurality of the video frames to identify video frames that include one or more of identifiable product-related logos, brand-related logos, product-related text, or brand-related text which appear in the video frames, performing audio analysis on the commercial to identify audio associated with one or more identifiable products or brands in the commercial, comparing the products and brands identified by the image analysis with the products and brands identified by the audio analysis, and identifying similar products and brands; and assigning to the commercial a product or brand as a primary metadata candidate when a similar product or brand is identified by the image analysis and the audio analysis.

Automated identification of product or brand-related metadata candidates for a commercial using consistency between audio and image elements of products or brands detected in commercials

A method and system are provided for assigning metadata candidates to a commercial by performing image analysis on a plurality of the video frames to identify video frames that include one or more of identifiable product-related logos, brand-related logos, product-related text, or brand-related text which appear in the video frames, capturing frame data for such video frames, calculating a dominance or prominence metric from the frame data for each of the identifiable product-related logos, brand-related logos, product-related text, or brand-related text, comparing the dominance or prominence metric for each of the identifiable product-related logos, brand-related logos, product-related text, or brand-related text to a predetermined threshold percentage or value, and assigning to the commercial, the identified products or brands as metadata candidates when the dominance or prominence metric exceeds the predetermined threshold percentage or value.

Automated identification of product or brand-related metadata candidates for a commercial using dominance and prominence of product or brand-related text or objects in video frames of the commercial

Audio information is monitored by a user device that performs audio content recognition of any received audio content. The user device includes a scheduling logic unit, a probe, and an audio signature generator. The scheduling logic unit maintains a set of scheduling rules that define conditions that were present when previous audio content recognition of audio content received by the user device was successful. The scheduling logic unit receives currently present conditions of the user device, and compares the currently present conditions to the set of scheduling rules to determine if the currently present conditions match any scheduling rules. The user devices captures ambient audio content via the probe and generates audio signatures of the captured audio content using the audio signature generator if a match occurs, and inhibits capturing audio content by the user device and/or inhibits generating audio signatures if a match does not occur.

Efficient apparatus and method for audio signature generation using recognition history

A method and system are provided for assigning metadata candidates to a commercial by performing image analysis on a plurality of the video frames to identify video frames that include one or more of identifiable product-related logos, brand-related logos, product-related text, or brand-related text which appear in the video frames, capturing frame data for such video frames, calculating a persistence metric from the frame data for each of the identifiable product-related logos, brand-related logos, product-related text, or brand-related text, comparing the persistence metric for each of the identifiable product-related logos, brand-related logos, product-related text, or brand-related text to a predetermined threshold value, and assigning to the commercial, the identified products or brands as metadata candidates when the persistence metric exceeds the predetermined threshold value.

Automated identification of product or brand-related metadata candidates for a commercial using persistence of product or brand-related text or objects in video frames of the commercial

Automated identification of product or brand-related metadata candidates for a commercial using consistency between audio and image elements of products of brands detected in commercials

Methods and apparatus are provided for generating an audio signature. An audio signal generator generates an audio signal. A speaker responsive to the audio signal generator outputs the generated audio signal. A probe including a microphone samples the generated audio signal detected by the microphone. An audio signature generator is connected to the probe and generates an audio signature from the sampled audio signal detected by the microphone. The audio signature generator generates the audio signature without requiring detection of any additional audio signal. A transmitter connected to the audio signature generator transmits the audio signature to a communications channel.

Apparatus and method for determining co-location of services using a device that generates an audio signal

Methods and apparatus are provided for determining a lift metric regarding effectiveness of a digital ad campaign for an audio-visual work on subsequent viewership of the audio-visual work. Viewed content from a universe of monitored AV audio-visual devices is collected. Identifiers of audio-visual devices that received an ad impression for the audio-visual work are also collected. The lift metric may be determined from statistical analysis of this data.

System and method for determining TV tune-in attribution

An audio signature is generated by a user device by generating an audio signal indicative of the user device, outputting the audio signal indicative of the user device through a speaker of the user device, using a microphone of the user device to sense audio, generating an audio signature of the audio sensed by the microphone in the user device, and transmitting the audio signature from the user device to a communication channel. The audio signal may be used by another user device which generates its own audio signature, and which can be compared to the audio signature of the user device that originally generated the audio signal to determine if the user devices are co-located.

Co-location of devices is determined by receiving at a query engine from a device, a remote audio signature and associated remote device identification and device location data and comparing in the query engine remote audio signatures stored in a database to the remote audio signature. The remote database further stores remote device identification and device location data associated with the stored audio signatures. The query engine only performs the comparisons for remote audio signatures that have the same location data. The query engine thereby limits its query set of remote audio signatures in the database. A processor reports a remote device identification associated with the remote audio signature of the device received over the communication channel and the remote device identification associated with the stored remote audio signature when an audio signature received over the communication channel matches an audio signature stored in the database within a threshold confidence level.

Apparatus and method for determining co-location of services

An automatic content recognition system that includes a user device for the purpose of capturing audio and generating an audio signature. The user device may be a smartphone or tablet. The system is also capable of determining whether a user device is in motion and refraining from audio monitoring and/or generating audio signatures when the user device is in motion. Motion may also be used to reduce the frequency of audio monitoring and/or signature generation. The system may have a database within the user device or the user device may communicate with a server having a database that contains reference audio signatures.

Efficient apparatus and method for audio signature generation using motion

Audio information is monitored by a user device by generating audio signatures of ambient audio content captured by the user device, receiving conditions of the user device that were present when the ambient audio content for each audio signature was captured, performing audio content recognition on the audio signatures by comparing in a query engine the generated audio signatures to audio signatures previously stored in a database associated with the query engine, identifying generated audio signatures that match audio signatures stored in the database within a threshold confidence level, thereby establishing successful audio content recognition, identifying the conditions of the user device that were present for successful audio content recognition, generating scheduling rules regarding the conditions present during successful audio content recognition and controlling when the user device captures audio content and/or generates audio signatures based on the scheduling rules.

Growing community of inventors

Mountain View, CA, United States of America

Ashish Chordia