Intel Corporation

Ub Video Inc.

Georgia Tech Research Corporation

Other

Cisco Technology, Inc.

Scientific-atlanta, Inc.

Faouzi Kossentini

Foued Ben Amara

Chekib Nouira

Anthony Joch

Hassen Guermazi

Nader Mahdi

James Au

Mark J Smith

Jill MacDonald Boyce

James M Holland

Nilesh K Jain

Brinda Ganesh

Sumit Mohan

Zhijun Lei

Sebastian Possos

Ali Jerbi

Ismaeil R Ismaeil

Amir Naghdinezhad

Alen Docef

Craig Hurst

Hassene Tmar

Omar Khlif

Techniques related to distributing the video encoding processing of an input video across hardware and software systems. Such techniques include evaluating the content of the video and determine whether or the encoding operation is best to be done on the hardware system only, software system only or a hybrid hardware and software system.

Offloading video coding processes to hardware for better density-quality tradeoffs

Techniques related to transform coefficient shaping for video encoding are discussed. Such techniques include applying weighting parameters from one or more perceptually-designed matrices of weighting parameters to blocks of transform coefficients to generate weighted transform coefficients and encoding the weighted transform coefficients into a bitstream. The process may be based on sets of perceptually designed matrices of weighting parameters. Classifier outputs may be used to select from the set of perceptually designed matrices a subset of matrices to work with. The latter may be used in a synthesis procedure to develop the final weighting matrix to be used is shaping the transform coefficients.

Human visual system optimized transform coefficient shaping for video encoding

Techniques related to video encoding are discussed that, for each block of input video, select an individual partitioning and coding mode selection technique from multiple such selection techniques. For a picture, the selection algorithm takes as input scores for individual blocks, costs of the various partitioning and coding mode selection techniques, and various detector outputs. The selection algorithm provides as output a partitioning and coding mode selection technique for each block in picture. The algorithms selection is such that the overall cost of the selected algorithms in the picture is as close as possible to a given picture budget. Furthermore, a partitioning and coding mode selection algorithms, binary depth partitioning (BDP), is discussed. For a block, BDP provides fast convergence to a partitioning and associated coding modes first evaluating intermediate partitioning options and converging on the final partitioning by evaluating either larger of smaller partitions.

Partitioning and coding mode selection for video encoding

Techniques related to video encoding that provide for a decoupled prediction and coding structure for improved performance are discussed. Such techniques include determining final partitioning decisions for blocks of a picture by evaluating intra modes for candidate partitions by comparing the candidate partitions to intra predicted partitions generated using only original pixel samples and evaluating inter modes for the candidate partitions by comparing the candidate partitions to search partitions including original pixel samples and encoding using the final partitioning decision.

Decoupled prediction and coding structure for video encoding

A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighboring motion vectors that use the same list of reference pictures as the motion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighboring motion vectors.

Computing predicted values for motion vectors

Low-complexity motion vector prediction systems and methods

A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighbouring motion vectors that use the same list of reference pictures as the notion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighbouring motion vectors.

Low-complexity motion vector prediction for video codec with two lists of reference pictures

A system and method is provided to avoid or otherwise reduce luminance and/or chrominance trailing artifacts in block-based hybrid video coders using multiple block sizes and shapes. The proposed trailing artifact avoidance approach has at its core three main components. The first component is a method to identify flat blocks in the source frame that are most susceptible to the appearance of trailing artifacts, and where flatness is determined according to several proposed criteria. The second component is a method to identify bad blocks, which refer to predicted blocks in motion estimation that correspond to flat blocks in the source frame and that contain trailing artifacts. The third component is a method to avoid trailing artifacts when they are detected within a bad block, and where the avoidance is achieved by employing one or more tools from among a proposed set of high fidelity coding tools and/or high performance motion estimation tools.

Trailing artifact avoidance system and method

A pre-processing system and method is used to compensate for global brightness changes in consecutive video frames. The system and method uses a brightness change model to identify the global brightness changes and to discard the brightness in a source frame so that the brightness changes between consecutive reconstructed video frames is kept to a minimum. The Hough Transform is used as one example of the model to accumulate votes for different values of brightness change model parameters. Compensation for any detected brightness changes in the source frame is performed with filtering of the model parameters when necessary, to help avoid any artifacts in the compensated source frame. Different application sequences of the brightness change model allows for multiple levels of processing delays.

Global brightness change compensation system and method

A video coding method progressively refines a predicted motion vector to obtain an estimated motion vector. Subsequent steps are omitted if the estimated motion vector matches a current macroblock. Variable matching thresholds can permit dynamic adjustment of image quality and computational cost to optimize encoding performance for available computational resources. The method permits control of desired encoding speed and bit rate by adjusting encoding parameters. Video coders according to the invention may comprise a motion estimator, transform computer and coder each of which operates according to one or more parameters. A speed rate control and/or a bit rate control may adjust the parameters to maintain a desired encoding speed and output bit rate. A coder according to the invention may be implemented in software running on a general purpose computer. The method may be used in block-based video encoders including MPEG-2 and H.263 encoders.

Method and apparatus for video coding

A subband coder with jointly optimized multistage residual quantizers and entropy coders for image coding which allows the subband coder to exploit both linear and non-linear dependencies that may exist within and across the subbands. Both inter- and intra-band dependencies are simultaneously exploited via jointly optimizing the subband coders and entropy coders in an entropy constrained optimization framework involving rate, distortion and complexity. The multistage quantization structure and the effectiveness of the statistical modeling algorithm results in an attractive balance among reproduction quality, rate and complexity.

Growing community of inventors

Vancouver, Canada

Faouzi Kossentini