Xerox Corporation

University of Rochester

Gozde Bozdagi

Ricardo L De Queiroz

A Murat Tekalp

Yucel Altunbasak

A method for processing compressed digital data derived from an original image sequence, the data being organized as a set of image frames, each image frame comprising a set of blocks, each block including a string of bits corresponding to an area of the original image frame in the original image sequence. A cost function is derived as a number related to the amount of bits spent to encode a block, sets of blocks, an image frame, or sets of image frames. A segmentation technique is applied to the map with cost functions. Temporal segmentation is performed by analyzing cost functions associated with each image frame. In both cases auxiliary functions can be used to improve the segmentation quality. The segmented regions of a image frame or sets of image frames can be identified, replaced, printed, or processed in special manners.

Using encoding cost data for segmentation of compressed image sequences

A system and a method for motion-compensated de-interlacing of interlaced video frames that generates high quality progressive video frames, keeps computational complexity low and requires the use of only a single image frame is provided. The system and method of this invention determine if global motion (camera motion) is present in the scene. If global motion is detected, it is estimated and compensated. The globally-compensated image is then analyzed to determine whether local motion is present. If local motion is detected, the image pixels affected by the local motion are interpolated using motion-adaptive techniques. If no local motion and no global motion is detected, the image pixels are interleaved.

System and method for motion compensated de-interlacing of video frames

In a temporal sequence of digitized image frames of video signals, the spatial and temporal image gradients and the pixel-to-pixel motion vectors (dense motion vectors) are obtained between two consecutive image frames. A shape-adaptive triangular patch mesh model overlay is provided on the first image frame such that the location of node points of each patch is determined by the spatial image gradients of the first frame and the pixel-to-pixel motion vectors. A priority ranking of patches is established before determining the node point motion vectors. The node point motion vectors, representing the motion of each of the node points of the triangular mesh patches, are estimated by a linear least-squares solution to an affine transformation of the mesh overlay on the first frame into the second frame. Failure regions are identified and are revised in accordance with a data bit budget. All data are coded prior to transmission at a constant data bit rate by a sending unit to a receiving unit over a data link.

Growing community of inventors

Rochester, NY, United States of America

Gozde Bozdagi