Interdigital Ce Patent Holdings, Sas

Julia Navarro

Julien Fleureau

Neus Sabater

Guillaume Boisson

Bertrand Chupeau

Methods and devices for generated multiplane images from a representation of a 3D scene are disclosed. When an MPI is generated by the system, an image of the accumulation of the alpha values is computed. A convolutional networked is trained with a penalization function that penalizes MPIs with high values of accumulated alpha according to a parameter selected or trained to reduce the redundancy of information between layers of the MPI. When generating a MPI from a subset of the views of a new captured 3D scene, a first MPI is generated with the trained CNN with the associated parameter. An error is calculated between the other views and corresponding synthesized with the first MPI. This error is used to modify the parameter. Then, a second MPI is generated with the trained CNN with the new parameter.

Method and apparatus for generating compact multiplane images

Methods and devices for generating a multiplane image from a representation of a 3D scene are disclosed. Given a representation of the 3D scene, for example as a multiview image, a first MPI is generated by a convolutional neural network trained for generating a MPI according to a provided sampling of the depths of the 3D scene. The presence of objects in different layers, that is the complementary of the accumulated transparency of layers, is analyzed to resample the sampling of layers' depth. The new sampling is used by the CNN to generate a new MPI from a representation of the same 3D scene.

Growing community of inventors

Palma, Spain

Julia Navarro