Interdigital Ce Patent Holdings

Interdigital Vc Holdings, Inc.

Thomson Licensing

Canon Kabushiki Kaisha

Interdigital Ce Patent Holdings, Sas

Benoit Vandame

Valter Drazic

Guillaume Boisson

Neus Sabater

Didier Doyen

Julien Fleureau

Fabien Racape

Laurent Blonde

Paul Kerbiriou

Mozhdeh Seifi

Pierre Hellier

Frederic Babon

Dominique Thoreau

Naël Ouedraogo

Philippe Guillotel

Renaud Dore

Bertrand Chupeau

Jurgen Stauder

Philippe Robert

Patrick Lopez

Cedric Thebault

Louis Chevallier

Thierry Borel

Pierrick Jouet

Arno Schubert

Olivier Bureller

Matthieu Hog

Mathilde Brossard

To represent a 3D scene, the MPI format uses a set of fronto-parallel planes. Different from MPI, the current MIV standard accepts a 3D scene represented as sequence input pairs of texture and depth pictures as input. To enable transmission of an MPI cube via the MIV-V3C standard, in one embodiment, an MPI cube is divided into empty regions and local MPI partitions that contain 3D objects. Each partition in the MPI cube can be projected to one or more patches. For a patch, the geometry is generated as well as the texture attribute and alpha attributes, and the alpha attributes may be represented as a peak and a width of an impulse. In another embodiment, an MPI RGBA layer of the MPI is cut into sub-images. Each sub-image may correspond to a patch, and the RGB and alpha information of the sub-image are assigned to the patch.

3D scene transmission with alpha layers

A method and system are provided for processing image content. In one embodiment the method comprises receiving a plurality of captured contents showing same scene as captured by one or more cameras having a different focal length and depth maps and generating a consensus cube by obtaining depth map estimations from said received contents. The visibility of different objects in then analysed to create a soft visibility cube that provides visibility information about each content. A color cube is then generated by using information from the consensus and soft visibility cube. The color cube is then used to combine different received contents and generate a single image for the plurality of contents received.

Method and device for processing image content

For multi-view video content represented in the MVD (Multi-view+Depth) format, the depth maps may be processed to improve the coherency therebetween. In one implementation, to process a target view based on an input view, pixels of the input view are first projected into the world coordinate system, then into the target view to form a projected view. The texture of the projected view and the texture of the target view are compared. If the difference at a pixel is small, then the depth of the target view at that pixel is adjusted, for example, replaced by the corresponding depth of the projected view. When the multi-view video content is encoded and decoded in a system, depth map processing may be applied in the pre-processing and post-processing modules to improve video compression efficiency and the rendering quality.

Depth map processing

In one embodiment of the disclosure, it is proposed a method for encoding a matrix of image views obtained from data acquired by a plenoptic camera. The method is remarkable in that it comprises: obtaining at least one reference image view from a combination of at least two image views from said matrix of image views; encoding image views that are different from said at least one reference image view, based on said at least one reference image view.

Method for encoding a matrix of image views obtained from data acquired by a plenoptic camera

The present invention generally relates to an apparatus and a method for obtaining a registration error map representing a level of sharpness of an image. Many methods are known which allow determining the position of a camera with respect to an object, based on the knowledge of a 3D model of the object and the intrinsic parameters of the camera. However, regardless of the visual servoing technique used, there is no control in the image space and the object may get out of the camera field of view during servoing. It is proposed to obtain a registration error map relating to an image of the object of interest generated by computing an intersection of a re-focusing surface obtained from a 3D model of said object of interest and a focal stack based on acquired four-dimensional light-field data relating to said object of interest.

Apparatus and a method for obtaining a registration error map representing a level of sharpness of an image

A device comprising filtering means having a pattern of at least four blocks wherein a second block is located vertical to a first block, a third block is located horizontal to said first block and a fourth block is located vertical to said third block and horizontal to said second block; and means to generate a new image from images captured using said filtered rays.

Filter array for demosaicing

A method for encoding at least one matrix of image views obtained from data acquired by a plenoptic camera is disclosed. Image views of the matrix of image views are partitioned into blocks. For a given image view of the at least one matrix of views, the method includes obtaining at least one block to be encoded and a matching block, wherein a difference between the at least one block to be encoded and the matching block fulfills a block matching criterion; determining a residual block regarding the at least one block to be encoded and the matching block, the determining using modified pixels of the at least one block to be encoded and modified pixels of the matching block according to flux variation parameters associated with a pixel sensor of the plenoptic camera; and encoding the residual block.

Method for encoding at least one matrix of image views obtained from data acquired by a plenoptic camera, and corresponding electronic devices

A method and an apparatus for depth-map estimation between at least two images respectively captured by at least two cameras are disclosed. Extrinsic and intrinsic parameters of the at least two cameras are obtained. Local spatial structure descriptors for each pixel of the at least two images are obtained by transforming a patch of pixels surrounding each pixel, and depth is obtained for at least one pixel of a first image among the at least two images, among at least two depth candidates, each depth candidate being associated with a corresponding pixel in a second image of the at least two images, said corresponding pixel in the second image being determined according to the obtained extrinsic and intrinsic parameters.

Method and apparatus for depth-map estimation

The disclosure concerns a method for filtering spurious pixels in a depth-map. It is important to filter a depth-map to remove the spurious pixels. One issue when filtering spurious pixels, is to remove them while preserving the boundaries of the real details of the depth-map. A known approach to filter spurious pixels is to use a bi-lateral filter. However, the bi-lateral filter is not efficient to remove the spurious pixels. The proposed solution enables to remove spurious pixels in a depth-map while preserving the sharp edges of the depth-map and smoothing faint details or noise.

Method for filtering spurious pixels in a depth-map

An apparatus to process a lightfield image of a scene acquired with a lightfield acquisition device comprises means for obtaining a first focal stack and a second focal stack, each comprising images representative of the scene and obtained from a different part of the pixels of the lightfield image. A method of processing the lightfield content is also described.

Method and device for processing a lightfield content

A method for creating a pair of stereoscopic images is described. The method includes using at least one lightfield camera which receives respective required camera parameters for a left view and a right view. The required camera parameters define a theoretical stereo image pair to acquire respective actual camera parameters for respective sub aperture images that are generated based on the captured image by the lightfield cameras, to determine a best matching sub aperture image for the left view by comparing the required camera parameter for the left view with the actual camera parameters for the respective sub aperture images, to determine a best matching sub aperture image for right view by comparing the required camera parameter for right view with the actual camera parameters for the respective sub aperture images, and to associate the best matching sub aperture image for left view and the best matching sub aperture image for right view as a pair of stereoscopic images.

Method and apparatus for creating a pair of stereoscopic images using least one lightfield camera

A method for encoding a current focal stack is disclosed that comprises a set of images focused at a different focalization distance from one image to another. According to present disclosure, the method comprises: &#x2014;encoding () information representing an image of the current focal stack, the image being selected in said current focal stack according to an image sharpness criterion, and reconstructing the image into a reconstructed image; &#x2014;encoding () at least another image of the current focal stack by prediction from at least the reconstructed image.

Method and device for encoding and decoding a light field based image, and corresponding computer program product

There are several types of plenoptic devices having a proprietary file format. At present, there is no standard supporting the acquisition and transmission of multi-dimensional information for an exhaustive over-view of the different parameters upon which a light-field depends. As such, acquired light-field data for different cameras have a diversity of formats. The notion of pixel beam, which represents a volume occupied by a set of rays of light in an object space of an optical system of a camera is introduced. The method according to the invention enables to provide data representative of a bokeh associated to a pixel beam. Such data representative of bokeh associated to a pixel beam enables the displaying of an image with good bokeh properties.

Method and apparatus for generating data representative of a bokeh associated to light-field data

A light-field capture device including a photo-sensor, a main lens configured to refract light from a scene towards an image focal field, a micro-lens array positioned in the image focal field between the main lens and the photo-sensor, each micro-lens being configured to project a micro-lens image onto a respective dedicated area of the photo-sensor. The light-field capture device is provided with at least one compressive sensing calculation unit connected to at least one of the dedicated areas and configured to calculate data such as for example standard deviation data representative of the homogeneity of input pixels of said dedicated area, and to provide output data representative of the input pixels of said dedicated area; the output data comprising either a number of output pixels corresponding to the number of input pixels, or a single output pixel, depending on the relative value of the homoegeneity compared with a threshold.

Growing community of inventors

Betton, France

Benoit Vandame