Interdigital Ce Patent Holdings, Sas

Thomson Licensing

Interdigital Ce Patent Holdings

Matthieu Hog

Neus Sabater

Christine Guillemot

Guillaume Boisson

Didier Doyen

Valter Drazic

Benoit Vandame

Erik Reinhard

Frederic Babon

Elena Garces

An apparatus and method for processing a light field comprising a plurality of views of a 3D scene includes obtaining a super-ray representation for the light field, wherein the super-ray representation comprises a plurality of super-rays, wherein each super-ray groups pixels corresponding to a set of light rays having a similar color from each of the plurality of views, and wherein the set of light rays for each super-ray originates from one area of the 3D scene; and processing the light field by processing the super-ray representation for the light field, wherein processing the light field comprises at least one of editing the light field, segmenting the light field, and refocusing the light field.

Method for processing a light field image delivering a super-rays representation of a light field image

The present disclosure concerns a method for processing a light field image comprising a set of image views. The method is remarkable in that it comprises:

A method is proposed for estimating a depth for pixels in a matrix of M images. Such method comprises, at least for one set of N images among the M images, 2&#x3c;N&#x2264;M, a process comprising: &#x2014;determining depth maps for the images in the set of N images delivering a set of N depth maps; &#x2014;for at least one current pixel for which a depth has not yet been estimated: &#x2014;deciding if a candidate depth corresponding to a depth value in the set of N depth maps is consistent or not with the other depth map(s) of the set of N depth maps; &#x2014;selecting the candidate depth as being the estimated depth for the current pixel if the candidate depth is decided as consistent. The process is enforced iteratively with a new N value which is lower than the previous N value used in the previous iteration of the process.

Method for estimating a depth for pixels, corresponding device and computer program product

A method and device for processing a light field video is described. The light field video includes a set of image views per unit of time, the light field video being associated with a scene without cuts. In the method a first super-rays representation of reference image views at a given time is determined based on centroids. A second super-rays representation associated with corresponding views of a subsequent set of image views is next determined based on de-projection and re-projection of centroids. The displacement of centroids between the first and second super-rays is determined and then the determined displacement is applied to centroids of the second super-rays representation.

Method for processing a light field video based on the use of a super-rays representation

The present disclosure concerns a method for processing a light field image comprising a set of image views. The method is remarkable in that it comprises: selecting () a set of pixels, named centroids, within a given image view in said light field image, each centroid being associated with a unique label and a unique light ray; de-projecting said centroids, that delivers a set of points in a 3D space; re-projecting said points of said set of points in a 3D space in at least one other image view in said light field image, which is different from said reference view, that delivers a set of re-projected centroids; and determining (), for each pixel, being associated with a light ray, within a neighborhood of a re-projected centroid, a label related to one of the centroids, said determining relying on a proximity criterion in term of color between pixels and centroids, and a proximity criterion in term of spatial distances between pixels and re-projected centroids; and updating (), for a given centroid, a color value associated with said given centroid, and spatial coordinates of said given centroid within said given image view, wherein said updating comprises: de-projecting pixels in said at least one other image view that are associated with a same label of said given centroid, delivering a set of obtained points; and re-projecting said obtained points into said given image view, delivering a set of projected points; and averaging both color values associated with said projected points and spatial coordinates associated with said projected points for defining updated information related to said given centroid.

A method for rendering an image, called a final image, from at least one image acquired by a camera array, is provided. According to such a method, the determination of a color value for at least one pixel of the final image, called a current pixel, comprises:

Method for rendering a final image from initial images acquired by a camera array, corresponding device, computer program product and computer-readable carrier medium

Selecting at least one surface in a light field, such as a light field associated with multiple views corresponding to different view points of a same scene, may include displaying one of the multiple views as a reference view, selecting at least one surface in the reference view, identifying a set of pixels belonging to the selected surface, which are occluded in the reference view but visible in at least one of the multiple views, projecting the set of pixels into the reference view on the basis of a value of the pixels of the set in the view or views in which they are visible in order to form an upgraded reference view, displaying the upgraded reference view, and updating the selected surface in the upgraded reference view.

Method and apparatus for selecting a surface in a light field, and corresponding computer program product

A method for obtaining a refocused image from 4D raw light field data for a given focus plane value g is described. The method is executed by an electronic device and is remarkable in that it comprises determining at least one pixel value, for at least one color component, of the refocused image at coordinates (k, l)&#x2208;N. The at least one projected pixel value with coordinates comprised in a neighborhood of said coordinates (k, l), for the at least one color component is determined, weighted and updated.

Method for obtaining a refocused image from 4D raw light field data

Method and device adapted for the processing of lightfield data representative of a scene, said lightfield data comprising a plurality of elements, 4-dimensional coordinates being associated with each element. Following operations are performed: associating a ray with each element, the ray being obtained from the 4-dimensional coordinates associated with each element; determining a depth information for each element; determining an origin of each ray in the scene according to the depth information; grouping rays having a same origin in the scene to form a plurality of groups; processing the lightfield data according to the plurality of groups.

Growing community of inventors

Thorigné Fouillard, France

Matthieu Hog