Koninklijke Philips Corporation N.v.

Dolby Laboratories Licensing Corporation

Koninklijke Philips Electronics N.v.

Wilhelmus Hendrikus Alfonsus Bruls

Reinier Bernardus Maria Klein Gunnewiek

Philip Steven Newton

Christiaan Varekamp

Wiebe De Haan

Johan Cornelis Talstra

Remco Theodorus Johannes Muijs

Arnaud Pierre Herve Bourge

Mark Jozef Willem Mertens

Chris Damkat

Vasanth Philomin

Karel Johannes Gerhardus Hinnen

Patrick Luc Els Vandewalle

Cornelis Wilhelmus Kwisthout

Fei Zuo

Martin Hammer

Christian Benien

Gerardus Wilhelmus Theodorus Van Der Heijden

Marc Helbing

Georgios Parlantzas

Michael Verberne

Meindert Onno Wildeboer

Bart Kroon

Frederik Jan De Bruijn

Jan Alexis Daniel Nesvadba

Stijn De Waele

Hendrik Frank Moll

Gopi Lakshminarayanan

Ralph Braspenning

Nehal R Dantwala

Dennis Daniel Robert Jozef Bolio

Patrick Luc E Vandewalle

Christian Varekamp

Geradus Wilhelmus Theodorus Van Der Heijden

Bart Koon

Arnaud Pierre Hervé Bourge

Gerardus Johannes Maria Vervoort

Bernhard Hubert Penz

Mathieu Holl

Mark Jozef Maria Kurvers

Stijn DeWaele

An encoder, decoder, encoding method and decoding method for 3DoF+ video are disclosed. The encoding method comprises receiving () multi-view image or video data comprising a basic view and at least a first additional view of a scene. The method proceeds by identifying () pixels in the first additional view that need to be encoded because they contain scene-content that is not visible in the basic view. The first additional view is divided () into a plurality of first blocks of pixels. First blocks containing at least one of the identified pixels are retained (); and first blocks that contain none of the identified pixels are discarded. The retained blocks are rearranged () so that they are contiguous in at least one dimension. A packed additional view is generated () from the rearranged first retained blocks and encoded ().

Packing of views for image or video coding

The invention relates to an apparatus for generating or processing an image signal. A first image property pixel structure is a two-dimensional non-rectangular pixel structure representing a surface of a view sphere for the viewpoint. A second image property pixel structure is a two-dimensional rectangular pixel structure and is generated by a processor () to have a central region derived from a central region of the first image property pixel structure and at least a first corner region derived from a first border region of the first image property pixel structure. The first border region is a region proximal to one of an upper border and a lower border of the first image property pixel structure. The image signal is generated to include the second image property pixel structure and the image signal may be processed by a receiver to recover the first image property pixel structure.

Generating and processing an image property pixel structure

A method and apparatus analyze a difference of at least two gradings of an image on the basis of: obtaining a first graded picture (LDR) with a first luminance dynamic range; obtaining data encoding a grading of a second graded picture (HDR) with a second luminance dynamic range, different from the first luminance dynamic range; and determining a grading difference data structure (DATGRAD) on the basis of at least the data encoding the grading of the second graded picture (HDR), which allows more intelligently adaptive encoding of the imaged scenes, and consequently also better use of those pictures, such as higher quality rendering under various rendering scenarios.

Apparatus and methods for analyzing image gradings

Video data signals are encoded such that the encoded video data signal comprises at least a primary and at least a secondary video data signal. The primary and secondary video data signal are jointly compressed. The primary video data signal is compressed in a self-contained manner, and the secondary video data signal is compressed using data from the primary video data signal. The jointly compressed video data signal is split into separate bitstreams, at least a primary bitstream comprising data for the primary video data signal and at least a secondary bitstream comprising data for the secondary video data signal, whereafter the primary and secondary bitstreams are multiplexed into a multiplexed signal, and the primary and secondary signals are provided with separate codes.

Method and system for encoding a video data signal, encoded video data signal, method and system for decoding a video data signal

A method of encoding a video data signal () is provided, together with a method for decoding. The encoding comprises providing color information () for pixels in an image, providing a depth map with depth information () for the pixels, providing transition information () being representative of a width () of a transition region () in the image, the transition region () comprising a depth transition () and blended pixels in which colors of a foreground object and a background object are blended, and generating () the video data signal () comprising encoded data representing the color information (), the depth map () and the transition information (). The decoding comprises using the transition information () for determining the width () of the transition regions () and for determining alpha values () for pixels inside the transition regions (). The determined alpha values () are used for determining the color of a blended pixel at the transition of a foreground object and a background object.

Efficient coding of depth transitions in 3D video

An apparatus for generating view images for a scene comprises a store () which stores three dimensional scene data representing the scene from a viewing region. The three dimensional scene data may e.g. be images and depth maps captured from capture positions within the viewing region. A movement processor () receives motion data, such as head or eye tracking data, for a user and determines an observer viewing position and an observer viewing orientation from the motion data. A change processor () determines an orientation change measure for the observer viewing orientation and an adapter () is arranged to reduce a distance from the observer viewing position relative to the viewing region in response to the orientation change measure. An image generator () generates view images for the observer viewing position and the observer viewing orientation from the scene data.

Apparatus and method for generating view images

Three dimensional [3D] image data and auxiliary graphical data are combined for rendering on a 3D display () by detecting depth values occurring in the 3D image data, and setting auxiliary depth values for the auxiliary graphical data () adaptively in dependence of the detected depth values. The 3D image data and the auxiliary graphical data at the auxiliary depth value are combined based on the depth values of the 3D image data. First an area of attention () in the 3D image data is detected. A depth pattern for the area of attention is determined, and the auxiliary depth values are set in dependence of the depth pattern.

Method and apparatus for combining 3D image and graphical data

An apparatus for processing a depth map comprises a receiver () receiving an input depth map. A first processor () generates a first processed depth map by processing pixels of the input depth map in a bottom to top direction. The processing of a first pixel comprises determining a depth value for the first pixel for the first processed depth map as the furthest backwards depth value of: a depth value for the first pixel in the input depth map, and a depth value determined in response to depth values in the first processed depth map for a first set of pixels being below the first pixel. The approach may improve the consistency of depth maps, and in particular for depth maps generated by combining different depth cues.

Apparatus and method for processing a depth map

The method of analyzing a difference of at least two gradings of an image on the basis of: obtaining a first graded picture (LDR) with a first luminance dynamic range; obtaining data encoding a grading of a second graded picture (HDR) with a second luminance dynamic range, different from the first luminance dynamic range; determining a grading difference data structure (DATGRAD) on the basis of at least the data encoding the grading of the second graded picture (HDR), allows more intelligently adaptive encoding of the imaged scenes, and consequently also better use of those pictures, such as higher quality rendering under various rendering scenarios.

Apparatuses and methods for analyzing image gradings

A 3-D picture signal is provided as follows. An image and depth components having a depth map for the image are provided, the depth map includes depth indication values. A depth indication value relates to a particular portion of the image and indicates a distance between an object at least partially represented by that particular portion of the image and the viewer. The 3-D picture signal conveys the 3-D picture according to a 3D format having image frames encoding the image. Extra frames (D, D') are encoded that provide the depth components and further data for use in rendering based on the image and the depth components. The extra frames are encoded using spatial and/or temporal subsampling of the depth components and the further data, while the extra frames are interleaved with the image frames in the signal in a Group of Pictures coding structure (GOP).

Versatile 3-D picture format

Efficient coding of depth transitions in 3D (video)

A three dimensional [3D] video signal () is provided for transferring to a 3D destination device (). Depth metadata is determined indicative of depths occurring in the 3D video data, which depth metadata includes a near value indicative of depths of video data nearest to a user. The 3D video signal, which comprises the 3D video data, now also includes the depth metadata. The 3D destination device () is enabled to retrieve the depth metadata, to provide auxiliary data, and to position the auxiliary data at an auxiliary depth in dependence of the retrieved metadata for displaying the auxiliary data in combination with the 3D video data such that obscuring the auxiliary data by said nearest video data, and/or disturbing effects at the boundary of the auxiliary data, is avoided.

Combining 3D video and auxiliary data that is provided when not reveived

A new method of encoding multiple view image information into an image signal including adding to the image signal a first image of pixel values representing one or more objects captured by a first camera; adding to the image signal a map comprising for respective sets of pixels of the first image respective values, representing a three-dimensional position in space of a region of the one or more objects represented by the respective set of pixels, and adding to the image signal a partial representation of a second image of pixel values representing one or more objects captured by a second camera, the partial representation including at least information of the majority of the pixels representing regions of the one or more objects not visible to the first camera.

Efficient encoding of multiple views

Growing community of inventors

Eindhoven, Netherlands

Wilhelmus Hendrikus Alfonsus Bruls