Stmicroelectronics Gmbh

Genesis Microchip Corporation

Tamiras Per Pte. Ltd., LLC

Gordon Petrides

Hari N Nair

In one embodiment of the present invention, a method is provided for performing motion compensated interpolation using a previous frame and a current frame of a displayable output, the method comprising: detecting the speed of an object in the displayable output relative to the speed of a background in the displayable output; and blending results from a halo reducing interpolator and a median interpolator, wherein the results of each of the interpolators are weighted based on the speed of the object, to arrive at an interpolated frame using the previous frame and the current frame.

Object speed weighted motion compensated interpolation

In one embodiment of the present invention, a method is provided for providing border handling in motion compensated interpolation, wherein a camera model is used to detect areas of predominant movements in a displayable output, and for each reveal or conceal area: it is determined whether the reveal or conceal areas is due to a camera movement or an object movement. If the reveal or conceal areas is due to a camera movement. The camera model is used to arrive at interpolated pixel values for pixels within the corresponding area. If the reveal or conceal areas is not due to a camera movement, arriving at interpolated pixel values for pixels within the corresponding area without using the camera model.

Border handling for motion compensated temporal interpolator using camera model

In one embodiment of the present invention, motion compensated interpolation is performed by locating full frame conceal and reveal areas, determining intermediate frame occlusion areas of an interpolated frame of the displayable output by locating intermediate frame conceal areas based on projected locations of pixels within the full frame conceal areas using forward motion vectors and information about a time slot for the interpolated frame, and by locating intermediate frame reveal areas based on projected locations of pixels within the full frame reveal areas using backward motion vectors and information about the time slot for the interpolated frame; for any pixels in the interpolated frame to which there is neither a forward vector nor a backward vector projecting: including the pixel in an intermediate frame conceal area if it is not located within the full frame reveal area; including the pixel in an intermediate frame reveal area if it is not located within the full frame conceal area; and using the intermediate frame conceal and reveal areas to interpolate values for pixels within an area of the interpolated frame.

Occlusion adaptive motion compensated interpolator

In one embodiment of the present invention, motion compensated interpolation is performed by locating full frame conceal and reveal areas, determining intermediate frame occlusion areas of an interpolated frame of the displayable output by locating intermediate frame conceal areas based on projected locations of pixels within the full frame conceal areas using primary forward motion vectors and information about a time slot for the interpolated frame, and by locating intermediate frame reveal areas based on projected locations of pixels within the full frame reveal areas using primary backward motion vectors and information about the time slot for the interpolated frame. The intermediate frame conceal areas are then modified by projecting locations of pixels using secondary forward motion vectors and the intermediate frame reveal areas are modified by projecting locations of pixels using secondary backward motion vectors.

Motion compensated interpolation system using combination of full and intermediate frame occlusion

Methods and apparatus, including computer program products, implementing and using techniques for computing motion vectors in a digital video sequence are disclosed. A recursive hierarchical method is used to determine a motion vector by using multiple resolution levels of the image frames. A best motion vector is first determined for the lowest resolution level. The best motion vector is propagated to a higher resolution level, where some adjustments are made and a new best motion vector is determined. The new best motion vector is propagated to yet another higher resolution level, where more adjustments are made and another new best motion vector is determined. This process is repeated until the highest, original, resolution level has been reached and a best motion vector has been identified. The identified best motion vector at the original resolution level is used for performing motion compensation.

Motion vector computation for video sequences

Methods and apparatus, including computer program products, implementing and using techniques for determining motion vectors to be used for interpolation of intermediary frames in a digital video sequence are disclosed. A first image frame including several image patches is received. A second image frame including one or more image patches corresponding to the image patches in the first image frame is received. For each image patch that occurs in both frames, the following operations occur: forward and backward motion vectors are determined for the image patch in the first image frame, forward and backward motion vectors are determined for the image patch in the second image frame, one motion vector from the first image frame and one motion vector from the second frame are selected and the selected motion vectors are used to establish an intermediary position of the image patch in an interpolated frame between the frames.

Vector selection decision for pixel interpolation

In one embodiment, a method is provided for performing motion compensated interpolation wherein, for any pixels in the interpolated frame to which there is neither a forward vector nor a backward vector projecting: including the pixel in an intermediate frame conceal area if it is not located within the full frame reveal area; including the pixel in an intermediate frame reveal area if it is not located within the full frame conceal area; and using the intermediate frame conceal and reveal areas to interpolate values for pixels within an area of the interpolated frame.

Intermediate frame occlusion estimation system using projected vectors

The computing forward and backward vectors in unique patterns to achieve improved horizontal and vertical detail of the video display while reducing data processing and storage overhead is disclosed. The invention comprises generating a unique pattern of forward and backward motion vectors. The motion vectors are calculated using a quincunx vector sub-sampling of the forward and backward motion vectors to generate the pattern of motion vectors. The unique pattern generated by the quincunx vector sub-sampling provides more symmetrical sampling in the horizontal, vertical and diagonal directions and the benefit of lower data processing overhead while performing frame rate conversion.

Growing community of inventors

San Jose, CA, United States of America

Gordon Petrides