Gracenote, Inc.

Roku, Inc.

Dewey Ho Lee

Markus Kurt Cremer

Jeffrey William Scott

Markus Kurt Peter Cremer

Nishit Umesh Parekh

Jaehyung Lee

Wilson Harron

Peter Dunker

Steven D Scherf

Konstantinos Antonios Dimitriou

David Henry Pearce

Sherman Ling Fung Li

Shashank C Merchant

Sherman Li

Kostantinos Dimitriou

Nishit Umesb Parekh

A computing system automatically detects, within a digital video frame, a video frame region that depicts a textual expression of a scoreboard. The computing system (a) engages in an edge-detection process to detect edges of at least scoreboard image elements depicted by the digital video frame, with at least some of these edges being of the textual expression and defining alphanumeric shapes; (b) applies pattern-recognition to identify the alphanumeric shapes; (c) establishes a plurality of minimum bounding rectangles each bounding a respective one of the identified alphanumeric shapes; (d) establishes, based on at least two of the minimum bounding rectangles, a composite shape that encompasses the identified alphanumeric shapes that were bounded by the at least two minimum bounding rectangles; and (e) based on the composite shape occupying a particular region, deems the particular region to be the video frame region that depicts the textual expression.

Methods and systems for scoreboard text region detection

A computing system determines accuracy of sport-related information extracted from a time sequence of digital video frames that represent a sport event, the extracted sport-related information including an attribute that changes over the time sequence. The computing system (a) detects, based on the extracted sport-related information, a pattern of change of the attribute over the time sequence and (b) makes a determination of whether the detected pattern is an expected pattern of change associated with the sport event. If the determination is that the detected pattern is the expected pattern, then, responsive to making the determination, the computing system takes a first action that corresponds to the sport-related information being accurate. Whereas, if the determination is that the detected pattern is not the expected pattern, then, responsive to making the determination, the computing system takes a second action that corresponds to the sport-related information being inaccurate.

Methods and systems for determining accuracy of sport-related information extracted from digital video frames

A computing system automatically detects, in a sequence of video frames, a video frame region that depicts a scoreboard. The video frames of the sequence depict image elements including (i) scoreboard image elements that are unchanging across the video frames of the sequence and (ii) other image elements that change across the video frames of the sequence. Given this, the computing system (a) receives the sequence, (b) engages in an edge-detection process to detect, in the video frames of the sequence, a set of edges of the depicted image elements, (c) identifies a subset of the detected set of edges based on each edge of the subset being unchanging across the video frames of the sequence, and (d) detects, based on the edges of the identified subset, the video frame region that depicts the scoreboard.

Methods and systems for scoreboard region detection

A computing system engages in digital image processing of received video frames to generate sport data that indicates a score and/or a time associated with a sport event. The digital image processing includes: (i) identifying a first frame region of the video frames based on the first frame region depicting a scoreboard; (ii) executing a first procedure that analyzes the identified first frame region to detect, within the identified first frame region, second frame region(s) based on the second frame region(s) depicting text of the scoreboard; (iii) in response to detecting the second frame region(s), executing a second procedure to recognize the text in at least one of the second frame region(s); and (iv) based at least on the recognizing of the text, generating the sport data. In response to completing the digital image processing, the computing system then carries out an action based on the generated sport data.

A computing system obtains a fingerprint of video content being rendered by a video presentation device, including a first portion representing a pre-established video segment and a second portion representing a dynamically-defined video segment. While obtaining the query fingerprint, the computing system (a) detects a match between the first portion of the query fingerprint and a reference fingerprint that represents the pre-established video segment, (b) based on the detecting of the match, identifies the video content being rendered, (c) after identifying the video content being rendered, applies a trained neural network to at least the second portion of the query fingerprint, and (d) detects, based on the applying of the neural network, that rendering of the identified video content continues. And responsive to at least the detecting that rendering of the identified video content continues, the computing system then takes associated action.

Detecting and responding to rendering of interactive video content

A computing system automatically extracting, from a digital video frame, scoreboard information including a first team name, a second team name, a first score, and a second score. The computing system (a) detects, within the digital video frame, a plurality of frame regions based on each detected frame region depicting text; (b) selects, from the detected frame regions, a set of frame regions based on the frame regions of the selected set cooperatively having a geometric arrangement that corresponds with a candidate geometric arrangement of the scoreboard information; (c) recognizes characters respectively within each of the frame regions of the selected set of frame regions; (d) based at least on the recognized characters in the frame regions of the selected set, detects the scoreboard information; and (e) records the detected scoreboard information.

Methods and systems for extracting sport-related information from digital video frames

Methods and systems for sport data extraction

A computing system compares various reference fingerprints each representing a reference media stream broadcast on a different respective known channel, and the computing system determines that a plurality of the reference fingerprints match each other, thus defining a multi-match group of the matching reference fingerprints. In response, the computing system identifies a fingerprint feature that could define a distinction between the reference fingerprints, and the computing system resolves the multi-match based on the identified feature, thereby determining the channel carrying the media stream being rendered by the media presentation device. And the computing system could then take channel-specific action based on the determined channel.

Media channel identification and action with multi-match detection and disambiguation based on matching with differential reference-fingerprint feature

A client device accesses a video input stream from an intermediate device for display. The client device analyzes the video input stream to determine that the video input stream matches a template corresponding to a screen portion. Based on the video input stream matching the template, a video output stream is generated and caused to be presented on a display. In some example embodiments, the analysis is performed while the client device is replacing video content received from a content source via the intermediate device. For example, commercials transmitted from a national content provider to a smart TV via a set-top box may be replaced with targeted commercials. During the replacement, menus generated by the set-top box may be detected and the replacement video altered by the smart TV to include the menus.

Dynamic video overlays

A computing system receives from a media presentation device a query fingerprint stream representing media content being presented by the media presentation device, where the query fingerprint stream has been determined to represent a first channel. The computing system then detects that a threshold mismatch exists between the received query fingerprint stream and a reference fingerprint stream representing the first channel, thus indicating a likelihood that the media presentation device has transitioned from presenting the first channel to presenting a second channel. Responsive to detecting the threshold mismatch, the system thus discontinues channel-specific action with respect to the first channel. For instance, the system could discontinue superimposing of first-channel-specific content on the presented media content and perhaps start superimposing of second-channel-specific content instead.

Method and system for detecting and responding to changing of media channel

A client device accesses a video input stream from an intermediate device for display. The client device analyzes the video input stream to determine that the video input stream matches a template indicating a change of speed. In some example embodiments, the analysis is performed while the client device is generating a video output stream that replaces video content received from a content source via the intermediate device. Based on the video input stream matching the template, the client device modifies the video output stream to show the change of speed. For example, commercials transmitted from a national content provider to a smart TV via a set-top box may be replaced with targeted commercials. During the replacement, fast-forwarding of the commercial may be detected by matching a template with the video input stream. While the video input stream is being fast-forwarded, the smart TV fast-forwards the targeted commercial.

Growing community of inventors

Berkeley, CA, United States of America

Dewey Ho Lee