Thomson Licensing

Dialogic Corporation

Dialogic (us) Inc.

Contentarmor

Dekun Zou

Jeffrey Adam Bloom

Shan He

Ran Ding

Sitaram Bhagavathy

Beibei Wang

Peng Yin

Oscar Divorra Escoda

Tao Liu

Niranjan Narvekar

Dong Tian

Tao Zhang

Glenn Lawrence Cash

Wenjun Lu

Wen Chen

Visual discomfort from depth jumps in 3D video content is reduced or avoided by detecting the occurrence of a depth jump and by changing the disparity of a group of received image frames including the frames at the depth jump in order to adjust the perceived depth in a smooth transition across the group of image frames from a first disparity value to a second disparity value. Depth jumps may be detected, for instance, when content is switched from one 3D shot to another 3D shot.

Method of presenting three-dimensional content with disparity adjustments

Implementations may relate to various aspects of modifying, or using, a coded bitstream, or to recovering watermarking information from data. In one implementation, a coded bitstream is modified to allow for the application of a watermark to the coded bitstream without changing the coding of any other syntax elements in the bitstream. This is performed by identifying conditions necessary to change a coded syntax element without disrupting the interpretation of subsequent coded elements. The coded syntax element is replaced with another coded value if the modified value generates the same decoding variables as the original value would have generated. Particular implementations focus on syntax elements coded using entropy coding, including, for example, Context-based Adaptive Binary Arithmetic Coding (CABAC). Regardless of the type of coding or watermarking, various implementations may provide for recovering watermarking information. Particular implementations recover watermarking information using detection data and feature information.

Modifying a coded bitstream

A security method for H.264 video streams and the like is provided that comprises: coding video data with incorrect or missing bytes, whereby the coded video is corrupted or distorted; generating replacement data that corrects the coded video during decoding; and distributing the replacement data to users.

Valid replacement data in encoded video

A method comprises accessing encoded video data; accessing a list of watermarks to the encoded video data; determining syntax elements for current blocks of video data and syntax elements of currents blocks with the watermarks; removing watermarks that cause visible artifacts based on differences in the syntax elements between the current blocks and current blocks with watermarks, thereby creating filtered list of acceptable watermarks. The method can further include determining coding variable ranges for the current block and current block with watermarks from the list; comparing the coding variable ranges for the current blocks and current blocks with watermarks from the list; and filtering out watermarks that yield coding variable ranges outside the coding variable ranges of the current blocks. Additionally, the method can include determining bit lengths of the current blocks and current blocks with watermarks from the list; comparing bit lengths of the current blocks and current blocks with watermarks from the list; and filtering out watermarks that yield bit lengths not equal to the bit lengths of the current blocks.

Changeable block list

A method for detecting and selecting watermarking in video coding is provided that comprises accessing a list of possible watermarks; generating propagation maps of modifications to the video that would be caused by applying the respective watermarks; generating a detection region responsive to each respective propagation map that includes blocks within the propagation map that collectively rank highest with respect to a selected detection criteria compared to each other region within the propagation map; selecting a threshold metric for evaluating detection regions; and removing watermarks from the list responsive to a comparison of their detection regions with the threshold metric.

Watermark detection using a propagation map

Systems and methods of measuring a temporal offset between audio content and video content that employ audio fingerprints from an audio signal in the audio content, and video fingerprints from video frames in the video content. The systems obtain reference audio and video fingerprints prior to transmission of video over a media channel, and obtain target audio and video fingerprints subsequent to transmission of the video over the media channel. Each fingerprint has an associated time stamp. Using the reference and target audio fingerprints and their associated time stamps, the systems determine an audio time stamp offset. Using the reference and target video fingerprints and their associated time stamps, the systems determine a video time stamp offset. Using the audio and video time stamp offsets, the systems determine a temporal offset between the video content and the audio content introduced by the media channel.

Audio video offset detector

A method comprises receiving original encoded video stream as one input, accessing encoded data divided into slices which are further divided into blocks, receiving the list of possible changes or watermarks as another input, accessing at least one block, decoding each slice, setting down each slice, extracting from the list those changes that apply to the at least one block, and constructing propagation maps from inter-prediction or intra-prediction using changes for the at least one block. The method can further comprise decoding luminance data using the propagation maps, comparing the luminance data to a fidelity threshold, and applying possible changes or watermarks to those not exceeding the fidelity threshold.

Propagation map

A method comprises providing a change to apply to video; dividing video into blocks; creating propagation map which captures only specific changes to blocks that would be changed by the application of the change; evaluating the change based on a luminance criterion as being a perceptible change or an imperceptible change; for propagation maps of an imperceptible change, storing the propagation map to a list, wherein the propagation map is the principle data structure to be applied to the video. The propagation map can be created by using motion vector changes associated with the change.

Luminance evaluation

Systems and methods of perceptual quality monitoring of video information, communications, and entertainment that can estimate the perceptual quality of video with high accuracy, and can be used to produce quality scores that better correlate with subjective quality scores of an end user. The systems and methods of perceptual quality monitoring of video can generate, from an encoded input video bitstream, estimates of one or more quality parameters relating to the video, such as the coding bit rate parameter, the video frame rate parameter, and the packet loss rate parameter, and provide these video quality parameter estimates to a predetermined video quality estimation model. Because the estimates of the video quality parameters are generated from the encoded input video bitstream as it is being received, the systems and methods are suitable for use as QoE monitoring tools.

Video quality monitoring

A method comprises accessing changes which can be watermarks in a list for coded data, the changes having an syntax element, an original value and an candidate alternative value; determining for a subset a group of compliant changes from the changes, the complaint changes being compliant with a coding protocol such as a CABAC encoding protocol; and selecting for the subset only compliant changes that result in the subset having only one candidate alternative value for each syntax elements and result in only compliant changes also meeting at least one performance criterion. The method can include determining fidelity, recoverability, or robustness of the watermarks and removing or preventing watermarks from being in the subset based on the fidelity, recoverability, or robustness, wherein fidelity, recoverability, and robustness are performance criteria. The method can include determining at least two performance values for the watermarks, determining some collective metric of the at least two performance values, and removing or preventing watermarks from being in the subset based on the same collective metric.

Selection of watermarks for the watermarking of compressed video

Systems and methods of identifying media content, such as video content, that employ fingerprint matching at the level of video frames. The presently disclosed systems and methods of identifying media content can extract one or more fingerprints from a plurality of video frames included in query video content, and, for each of the plurality of video frames from the query video content, perform frame-level fingerprint matching of the extracted fingerprints against fingerprints extracted from video frames included in a plurality of reference video content. Using the results of such frame-level fingerprint matching, the presently disclosed systems and methods of identifying media content can identify the query content in relation to an overall sequence of video frames from at least one of the plurality of reference content, and/or in relation to respective video frames included in a sequence of video frames from the reference content.

Content identification using fingerprint matching

Systems and methods of objective video quality measurement based on support vector machines. The video quality measurement systems can obtain information pertaining to features of a target training video, obtain corresponding information pertaining to features of a reference version of the target training video, and employ the target training features and/or the reference training features to build video quality models using such support vector machines. Based on the target training features and/or the reference training features used to build such video quality models, the video quality models can be made to conform more closely to the human visual system. Moreover, using such video quality models in conjunction with target features of a target video whose perceptual quality is to be measured, and/or reference features of a reference video, the video quality measurement systems can be employed to predict measurements of the perceptual quality of such a target video with increased accuracy.

Support vector regression based video quality prediction

Noise, either in the form of comfort noise or film grain, is added to a three dimensional image in accordance with image depth information to reduce human sensitivity to coding artifacts, thereby improving subjective image quality.

Comfort noise and film grain processing for 3 dimensional video

A method of providing CABAC compliant changes such as watermarks comprises accessing encoded data such as video which comprise at least two blocks; creating or accessing a list of changes to the encoded data that include a direct change to a block; determining motion character or motion vector differential of non-immediate block, non-immediate blocks being adjacent to an immediate block that are immediately adjacent to the block; determining change to the immediate block based on original motion character of the block and the non-immediate block and the motion character of the block that would result from the application of the change; storing the change to the list if the change does not cause a difference to the immediate block; and evaluating other potential changes if other potential changes are available, wherein the other potential changes are subjected to the same process steps as the direct change.

Growing community of inventors

Princeton, NJ, United States of America

Dekun Zou