Entropic Communications, Inc.

Roku, Inc.

Koninklijke Philips Corporation N.v.

Other

Nxp B.v.

Trident Microsystems (far East) Ltd.

Erwin B Bellers

Paul Nangeroni

Gerard De Haan

Sunil Ramesh

Michael Cutter

Adil Jagmag

Haiyan He

Kenny Wu

Johan Gerard Willem Maria Janssen

Hugo Du Plooy

Rajesh Murthi

Robert Caston Curtis

Stephen A Herman

Franciscus Hendrikus Van Heesch

Johan Gerard Janssen

James Wallace Wendorf

Thijs Thomas Withaar

Mustafa Ozgen

Johan G W M Janssen

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for modifying one or more parameters of a data streaming payload to add optimized display and/or audio settings as metadata. An example embodiment operates by training and operating a first machine learning model to predict optimized picture and sound settings. A second embodiment operates by training a learning model with crowdsourced individual user manual adjustments to the display device display during playback. Having the optimized display settings in advance allows adjustments to be made in advance of playback.

Content classifiers for automatic picture and sound modes

A method and system to dynamically configure a display controller based on configuration of a display panel with which the display controller is connected. An example method includes the display controller detecting that the display panel is connected with the display controller. And the example method further includes, responsive to detecting that the display panel is connected with the display controller, (i) the display controller determining a configuration of the display panel, and (ii) based on the determined configuration of the display panel, the display controller dynamically configuring itself to interwork with the connected display panel having the determined configuration. This method could enable selective connection of a display controller with a display panel and automatic configuration of the display controller based on the configuration of the display panel.

Dynamic configuration of display controller based on configuration of connected display panel

In one aspect, a method includes receiving video content comprising a first data portion comprising parameters that control a visual appearance of frames of video content presented by a content-presentation device. The content-presentation device is communicatively coupled to a light unit that is (i) present in a viewing area of the content-presentation device and (ii) configured to provide ambient light in the viewing area. The method also includes extracting, from the received video content, a second data portion, separate from the first data portion, specifying one or more light control parameters that a controller associated with the light unit is configured to interpret as instructions for controlling the light unit. The method also includes transmitting the extracted second data portion to the controller to facilitate the controller controlling the light unit according to the specified one or more light control parameters.

Method and system for controlling lighting in a viewing area of a content-presentation device

A de-interlacing device and method are provided that may be used in a memory based video processor. The de-interlacer mixes the output of a temporal de-interlacer and a spatial de-interlacer. Two separate error values are used; one for the temporal de-interlacer and another for the spatial de-interlacer. The de-interlacing device calculates from the two error values, using a non-linear mapping, a mix factor used to mix between the outputs of the spatial and temporal de-interlacers.

Spatial and temporal de-interlacing with error criterion

Image data is processed to present a pleasing display. According to an example embodiment, each pixel of an input video frame is filtered using a variable frequency response filter that is responsive to the motion velocity of the pixel being filtered (e.g., filters data above or below a threshold based upon the motion velocity). A peaked video frame and a blurred video frame are generated for each input video frame using the filtered pixels.

Arrangement and approach for motion-based image data processing

An apparatus to provide a fall-back procedure for a PRC imaging device is described. The apparatus includes a PRC controller, a system resource monitor, and a PRC setting calculator. The PRC controller outputs a stream of images at an adjustable temporal rate. The adjustable temporal rate is constrained within a range defined by a first predetermined rate and a second predetermined rate. The system resource monitor obtains a measurement of system resource utilization. The PRC setting calculator determines a setting for the PRC controller in response to the measurement of system resource utilization. Additionally, the PRC controller determines a value for the adjustable temporal rate in response to the setting.

Temporal fallback for high frame rate picture rate conversion

Image data is processed to produce an output using a frame insertion approach. According to an example embodiment, frames are generated for video data, based upon the video data and the presence (or absence) of artifacts in the video data. In one application, a dynamic frame insertion approach is used to selectively generate peaked and blurred video frames in a manner that mitigates undesirable display and/or enhancement of artifacts by tuning down or turning off the generation and/or insertion of video frames.

Arrangement and approach for image data processing

A system and method for frame rate conversion using multi-resolution temporal interpolation utilizes motion estimation on input images to produce at least one motion vector and temporal interpolation on the input images in at least one spatial resolution that is determined by a characteristic of the at least one motion vector.

System and method for frame rate conversion using multi-resolution temporal interpolation

A system and method for distributing candidate motion vectors divides a picture frame () into a plurality of segments (), where each segment () includes a plurality of pixel blocks (). The local motion complexity of each segment may then be measured by determining a Sum-of-Absolute Differences (SAD) between pixel blocks () of the frame () and pixel blocks ()of an adacent frame () and summing the SAD values for the pixel blocks () within each segment (). The maximum, minimum and average SAD value for the segments may be used to define a distribution function that distributes candidate vectors to conform with a desired maximum, minimum and average number of candidate vectors per block. This distribution function is then used to determine the number of candidate vectors to assign to pixel blocks () based on the measured SAD value of the associated segment ().

Distributing candidate vectors based on local motion complexity

A sampling system adapts the sampling rate for sampling analog signals and/or the stored number of samples to the fixed or video image content, such that a higher rate, and equivalently a larger number of samples, are acquired for an image or video segment containing higher spatial frequencies while a lower number of samples (lower sampling rate) are retained for image or video segments containing lower spatial frequencies. The Nyquist theorem may still be satisfied for each individual image segment, while information necessary for edge enhancement is retained.

Dynamic sampling

In a video processing system where motion vectors are estimated for a subset of the blocks of data forming a video frame, and motion vectors are interpolated for the remainder of the blocks of the frame, a method includes determining, for at least at least one block of the current frame for which a motion vector is not estimated (), whether a block to the left or right has an estimated zero motion vector (), determining whether the at least one block had an estimated zero motion vector in a previous frame (), and if both determinations are affirmative (), providing a predetermined motion vector for the at least one block. The predetermined motion vector may be a zero motion vector ().

Biased motion vector interpolation for reduced video artifacts

An image conversion unit () for converting an input image into an output image includes a first computing device () for computing a first weighted sum of a first group of pixel values, the first group of pixel values corresponding to pixels of the input image; a second computing device () for computing a second weighted sum of a second group of interpolated values, the second group of interpolated values being computed by interpolation for spatial locations which are not present at the sampling grid of the input image; a combining device () for computing a third sum by combining the first weighted sum and the second weighted sum; and a clipping device () for clipping the third sum between a minimum value and a maximum value, the minimum value and the maximum value being derived from pixel values of the input image.

Post-processing of interpolated images

A video signal processor enhancing video information evaluates candidate vectors of enhancement algorithms utilizing an error function biased towards spatio-temporal consistency with a penalty function. The penalty function increases with the distance&#x2014;both spatial and temporal&#x2014;of the subject block from the block for which the candidate vector was optimal. Enhancements are therefore gradual across both space and time and the enhanced video information is intrinsically free of perceptible spatio-temporal varying artifacts.

Growing community of inventors

South Salem, NY, United States of America

Erwin B Bellers