Koninklijke Philips Corporation N.v.

Johan Gerard Janssen

Lilla Boroczky

Stephen A Herman

Liza G Boland

Michael Bakhmutsky

Erwin B Bellers

James Wallace Wendorf

Haiyan He

Fons Bruls

Yibin Yang

Egbert G T Jaspers

Rob Vogelaar

An apparatus and method for enhancing the quality of a digital video signal uses coding information for use in connection with spatial domain sharpness enhancement algorithms used in multimedia devices. The sharpness of previously encoded or transcoded digital video images is enhanced without enhancing encoding artifacts. The apparatus includes a usefulness metric generator that identifies a limit to the sharpness enhancement of an image that can be applied to a previously coded digital video that represents a sequence of images without enhancing coding artifacts. The usefulness metric generator applies the usefulness metric to at least one sharpness enhancement algorithm. The usefulness metric and the sharpness enhancement algorithm are separate so that the usefulness metric can be used with a variety of video enhancement algorithms.

Apparatus and method for providing a usefulness metric based on coding information for video enhancement

An apparatus and method for processing a multimedia digital bitstream is disclosed. The apparatus comprises a processing chain made up of a plurality of media processors. Each media processor processes a portion of the multimedia digital bitstream in real time. Each portion of the multimedia digital bitstream is split into a primary bitstream and a secondary bitstream. The primary bitstream is processed and merged with the unprocessed secondary bitstream. The parallel processing method of the present invention enables the processing chain to output a fully processed bitstream in real time. The processing chain may be used to transcode a high definition (HD) video bitstream in real time using a plurality of bitrate transcoder units.

Apparatus and method for parallel multimedia processing

A system, (i.e., a method, an apparatus, and computer-executable process steps), providing sharpness enhancement for coded video, in which a usefulness metric, calculates how much a pixel can be enhanced without increasing coding artifacts. The usefulness metric is separate from the enhancement algorithm such that a variety of different enhancement algorithms can be used in conjunction with the metric.

Method and system for sharpness enhancement for coded video

There is disclosed an apparatus for performing segmentation-based enhancements of a video image. The apparatus comprises: 1) an input buffer for storing video frames of an incoming video signal; 2) a segmentation controller capable of segmenting a first stored frame into a plurality of segments, each of the plurality of segments comprising a plurality of pixels having at least one common property; 3) an image processor capable of calculating a probability function associated with at least one pixel in the first stored frame, the probability function indicating a probability that the at least one pixel belongs within a first selected one of the plurality of segments; and 4) an enhancement controller capable of enhancing a parameter of the at least one pixel as a function of the probability function of the at least one pixel.

System and method for performing segmentation-based enhancements of a video image

In accordance with the preferred embodiment of the present invention, a method of and system for improving temporal consistency of an enhanced signal representative of at least one frame using a sharpness enhancement algorithm with an enhancement gain are provided. The method comprises the steps of: receiving the enhanced signal comprising at least one frame, obtaining an enhancement gain for each pixel in the frame, retrieving an enhancement gain value of each pixel in a reference frame from a gain memory using motion vectors, identifying if the frame is an I, P or B frame type and determining an updated enhancement gain for an I frame type by calculating a gain map for use in the sharpness enhancement algorithm. The updated enhancement gain of each pixel is equal to enhancement gain previously determined for use in the sharpness enhancement algorithm. In addition, the method includes storing the updated enhancement gain to gain memory, and applying the updated enhancement gain to the sharpness enhancement algorithm to improve temporal consistency of the enhanced signal. The method may further comprise the step of further improving the updated enhancement gain by applying a motion adaptive temporal IIR filter on the updated enhancement gain.

Method of and system for improving temporal consistency in sharpness enhancement for a video signal

Pixels in a video image may be segmented based upon selected criteria, such as a common color, texture, shape, amplitude range or temporal variation. Color values for these pixels may be used to calculate a color probability function which indicates the probability that the color value of the pixel will lie within a designated range of values. The pixels are also used to calculate a texture probability function that indicates whether the pixel represents a designated texture. Pixels that are assigned to a given segment may then be further processed to improve the quality of an image. In this manner, pixels that identify grass, sky, human skin, etc. may be identified and processed in order to achieve a more pleasing appearance.

Automatic segmentation-based grass detection for real-time video

The two dimensional sample rate conversion capabilities of a video display system are used to produce three-dimensional effects. Linear and non-linear scaling is applied to a video image to convey a sense of depth. The three dimensional effects are used to increase the visual appeal of existing and new feature sets in display systems. A multi-faceted object representation, such as a representation of a cube or a pyramid, can be used to display different video images on each facet of the representation. By appropriately scaling each image on each facet, an impression of depth is achieved. The images on the different facets can be selected to represent different aspects of a common theme, such as datacast information related to a primary source of information. Channel changing on a television can be presented as a rotation of the multifaceted object. In like manner, other familiar representations, such as a representation of a book can be used, wherein channel changing is presented as a turning of the pages of the book, each television program being presented on a different page. Advanced features, such as program categorization, can be represented as tabs on the book that facilitate the selection of a particular category. In like manner, a rotation of a multifaceted object about one axis may correspond to a change of channel within a select category, whereas a rotation about another axis may correspond to a change of category. Techniques are presented for achieving these three dimensional effects with calculations that are well suited for execution via the sample rate converters of conventional display systems.

Video sample rate conversion to achieve 3-D effects

A contrast control and clipping device is configured to determine a maximum range of enhancement that may be applied to each pixel for picture sharpness enhancement. This maximum range is used to limit the enhancement that is determined by the conventional convolution kernel and gain control modules. Preferably, the maximum range is independent of the determined convolution value, thereby minimizing the bandwidth requirements among the modules used for picture sharpness enhancement. The reduced bandwidth requirement allows for an efficient partitioning of tasks between hardware and software embodiments, and eases the overall system design task. In a multi-media application, the amount of data that is transferred between the processor and sub-components is substantially reduced, and the efficient partitioning facilitates parallel processing. The maximum range of enhancement is determined based on the pixel values in the current field, using a computationally simple algorithm, thereby minimizing anomalies caused by temporal dependencies among the modules that are used for picture sharpness enhancement. Additionally, the sharpness enhancement is dynamically adjusted based on overall picture-level characteristics, including the average enhancement range, overall noise measures, and so on.

Adaptive clipping prevention for picture sharpness enhancement

A filter structure is provided that facilitates the use of the filter as either a continuous delay Farrow filter or a selectable delay polyphase filter. The less complex polyphase filter is used when the desired scale substantially corresponds to a defined phase of the polyphase filter, or when time or power is not available to achieve the desired scale exactly; otherwise, the continuous delay Farrow filter is used. By providing an ability to switch to a continuous delay, the number of stages of the polyphase filter can be reduced. Additionally, an inversion of a Farrow filter is presented that provides for a continuous delay decimation filter with substantially reduced computational complexity compared to a direct embodiment of a Farrow filter. This inverted filter is also configurable as a polyphase filter, to provide selectable scale-resolution capabilities.

Image interpolation and decimation using a continuously variable delay filter and combined with a polyphase filter

There is disclosed an apparatus for sharpening an edge in a video image. The apparatus comprises: 1) a first circuit for determining a first luminance value of a first pixel associated with the first edge and a second luminance value of a second pixel associated with the first edge, wherein the first and second pixels are adjacent pixels; 2) a second circuit for determining a position of a first subpixel disposed between the first and second pixels, wherein the first subpixel position is disposed approximately at a center of the first edge; 3) a third circuit for increasing a luminance value of a second subpixel disposed on a first side of the first edge center; and 4) a fourth circuit for decreasing a luminance value of a third subpixel disposed on a second side.of the first edge center opposite the first side.

Growing community of inventors

Ossining, NY, United States of America

Johan Gerard Janssen