Koninklijke Philips Corporation N.v.

Ultra-d Cooperatief U.a.

Nxp B.v.

Tp Vision Holding B.v.

Entropic Communications, Inc.

Trident Microsystems (far East) Ltd.

Philips Intellectual Property & Standards Gmbh

Bart Gerard Bernard Barenbrug

Kornelis Meinds

Abraham Karel Riemens

Robert-Paul Mario Berretty

Christiaan Varekamp

Mark Jozef Willem Mertens

Frederik Jan De Bruijn

Michiel Adriaanszoon Klompenhouwer

Remco Theodorus Johannes Muijs

Reinier Bernardus Maria Klein Gunnewiek

Leo Jan Velthoven

Fabian Edgar Ernst

Bernardus Antonius Maria Zwaans

Waltherus Antonius Hendrikus Roelen

Ling Shao

Jose Pedro Magalhaes

Patrick Fernandes Machado

Jan Stroemer

Franciscus Johannes Peters

Peter Roelen

Harald Hermanus Albertus Van Woerkom

Christian Benien

Felix Gremse

Marc Helbing

Stefanie Mehl

Harald Helmut Uerlings

A processor system and computer-implemented method are provided for assigning view numbers to display elements of an autostereoscopic display for use in interleaving image data of different viewpoints of a scene on the basis of said assigned view numbers. The assignment is performed in an efficient yet accurate manner and may be easily adapted to different optical designs of such autostereoscopic displays, for example, in terms of pitch and/or slant of the optical elements used in such autostereoscopic displays, or to different sub-pixel layouts of the display panel.

Assigning new numbers to display elements of an autostereoscopic display

A display processor and computer-implemented method are provided for processing three-dimensional [3D] image data for display on a 3D display. The 3D display is arranged for emitting a series of views of the 3D image data which enables stereoscopic viewing of the 3D image data at multiple viewing positions. The series of views may be displayed on the 3D display using overscan. The degree of overscan may be determined as a function of one or more depth range parameters, the one or more depth range parameters characterizing, at least in part, a degree of depth perceived by a viewer when the series of views is displayed on the 3D display.

Overscan for 3D display

Some embodiments are directed to an integrated circuit and computer-implemented method for estimating a depth map from an image using a joint bilateral filter at reduced computational complexity. For that purpose, image data of an image is accessed as well as depth data of a template depth map. A joint bilateral filter is then applied to the template depth map using the image data as a range term in the joint bilateral filter, thereby obtaining an image-adapted depth map as output. The applying of the joint bilateral filter includes initializing a sum-of-weighted-depths volume and a sum-of-weights volume as respective empty data structures in a memory, performing a splatting operation to fill said volumes, performing a slicing operation to obtain an image-adapted depth volume, and performing an interpolation operation to obtain an image-adapted depth value of the image-adapted depth map for each pixel in the image.

Efficient implementation of joint bilateral filter

Three dimensional image data is provided which includes data representing a first image which specifically may be a background image. A mixed image which is a combination of the first image and a second image which specifically may be a foreground image, a transparency map related to the mixed image comprising transparency values for pixels of the mixed image and a depth indication map for the mixed image comprising depth indication values for pixels of the mixed image. The use of a mixed image may allow three dimensional processing while at the same time allowing 2D backwards compatibility. Image quality around image objects may be improved by modifying transparency values in response to depth indication values and/or depth indication values in response to transparency values. Specifically, an improved alignment of transitions of depth indication values and transparency values may provide improved three dimensional foreground image object edge data.

Three dimensional image data processing

A method of processing an image signal comprising image and depth information is provided. The method is configured to perform segmentation on an image based on depth/disparity information present in the image signal comprising said image, and subsequently inpaint background for correction of the errors in the image around the foreground objects into a region that extends beyond the segment boundary of the foreground object and/or inpaint foreground for correction of errors in the image into a region that extends inside the segment boundary of the foreground object. In this way compression and other artifacts may be reduced.

Use of inpainting techniques for image correction

A method and apparatus for rendering of image data for a multi-view display, such as image data for a lenticular auto-stereoscopic display, is disclosed. The method comprises the steps of receiving an image signal representing a first image, the first image comprising 3D image data, and spatially filtering the first image signal to provide a second image signal. The second image signal represents a second image, the spatial filtering being, e.g., a low-pass filter, a high-pass filter or a combination of a low-pass and a high-pass filter. A strength of the spatial filter is determined by a reference depth of the first image and a depth of an image element of the first image. The second image is sampled to a plurality of sub-images, each sub-image being associated with a view direction of the image.

Depth dependent filtering of image signal

A device and method for rendering content that includes analyzing previous and/or subsequent temporal portions of a content signal to determine elements that are positionally related to elements of a current portion of the content signal. The current portion of the content signal is rendered on a primary rendering device, such as a television, while the elements that are positionally related to elements of a current portion of the content signal are concurrently rendered on a secondary rendering device. In one embodiment, the elements that are rendered on the secondary rendering device may be rendered at a lower resolution and/or lower frame rate than the rendered current portion of the content signal. In one embodiment, at least one of previous and subsequent temporal portions of a content signal may be analyzed at a lower resolution than the content signal.

Adaptive content rendering based on additional frames of content

The invention relates to a method, apparatus and system for processing first depth-related information associated with an image sequence. The method of processing comprises mapping first depth-related information of respective images of a shot of the image sequence on corresponding second depth-related information using a first estimate of a characteristic of the distribution of first depth-related information associated with at least one image from the shot, the mapping adapting the first depth-related information by enhancing the dynamic range of a range of interest of first depth-related information defined at least in part by the first estimate, and the amount of variation in the mapping for respective images in temporal proximity in the shot being limited.

Method, apparatus and system for processing depth-related information

Therefore, a computer graphics processor with a forward mapping renderer is provided. The renderer comprises a texture space rasterizer (TS) for rasterizing a primitive in texture space, a color generating unit (PS) for determining the color of the output of the texture space rasterizer (TS) and for forwarding a color sample along with coordinates, a 2 pass screen space resampler (SSR, SSR) for resampling the color sample determined by the color generating unit (PS), and at least one one-dimensional blur filter unit (1PB, 2PB) associated to at least one pass of said screen space resampler (SSR, SSR) for performing a one-dimensional filtering before performing said at least one pass.

Computer graphics processor and method of rendering images

2D image data are converted into 3D image data. The image is divided, on the basis of focusing characteristics, into two or more regions, it is determined to which region an edge separating two regions belongs. The regions are depth ordered in accordance with the rule that the rule that a region comprising an edge is closer to the viewer than an adjacent region and to the regions 3-D depth information is assigned in accordance with the established depth order of the regions. Preferably to each of the regions a depth is assigned in dependence on an average or median focusing characteristic of the region.

Stereoscopic image display method and apparatus, method for generating 3D image data from a 2D image data input and an apparatus for generating 3D image data from a 2D image data input

A method of up-scaling a first structure of samples representing a first property, the first structure having a source resolution, into a second structure of samples representing the first property, the second structure having a target resolution, on basis of a third structure of samples representing a second property, the third structure having the source resolution and on basis of a fourth structure of samples representing the second property, the fourth structure of samples having the target resolution, the method comprising: assigning weight factors to respective first samples of the first structure of samples on basis of differences between respective third samples of the third structure of samples and fourth samples of the fourth structure of samples; and computing the second samples of the second structure of samples on basis of the first samples of the first structure of samples and the respective weight factors.

Up-scaling

A display control system () comprises an input () for receiving an image to be displayed by means of a backlight () and a transmissive panel (). A backlight controller () provides different colors or luminances for causing the backlight () to sequentially apply the different colors or luminances to the transmissive panel () in time-sequential sub-fields of the image. A transmissive panel controller () provides transmittivities for causing the transmissive panel () to sequentially apply the transmittivities to the transmissive panel in the time-sequential sub-fields of the image for displaying the image. The transmissive panel controller () selects a transmittivity based on a predetermined amount of off-axis gamma distortion of the transmissive panel.

Control of a display

A graphics pipeline () for rendering graphics receives texture data () and vertex data (). The texture data () define rectangular texture maps (), which are axis-aligned in texture space. The vertex data () describe output quadrilaterals () in screen space. A rasterizer () rasterizes the input rectangle () by determining which texels are inside the input rectangle (). A mapper () maps the texels inside the input rectangle () onto the output quadrilaterals (). The mapping is performed by calculating screen space output coordinates from the texture space grid coordinates of the texels. For the calculation an equation is used comprising at least one linear combination of the texture space grid coordinates of the texels inside the input rectangles () and at least one product of real powers of the texture space grid coordinates of the texels inside the input rectangles ().

Graphics pipeline for rendering graphics

A rendering unit () for rendering an output image () comprising output pixels, on basis of an input image () comprising input pixels and on basis of depth related data elements corresponding to the respective input pixels is disclosed. The rendering unit () comprises: a shift computing unit () for computing shift values to be applied to the input pixels, on basis of the respective depth related data elements; and an interpolation unit () for computing the output pixels on basis of shifting the input pixels with the respective shift values. The shift computing unit () is configured to provide an output value as the first one of the shift values, which is substantially equal to zero if the corresponding first one of the input pixels corresponds to overlay, independent of the corresponding depth related data element.

Depth perception

An apparatus for mapping primitives of a 3D graphics model from a texture space to a screen space. The apparatus includes a texture memory for storing texture maps. A resampler resamples, for each primitive, data from a texture map that corresponds to the primitive to corresponding pixel data defining a portion of a display image that corresponds to the primitive. The texture space resampler and/or the screen space resampler is operative to select a resampling algorithm for performing the resampling from a respective set of at least two distinct resampling algorithms. The selection is done in dependence on a size of the primitive.

Growing community of inventors

Eindhoven, Netherlands

Bart Gerard Bernard Barenbrug