Siemens Aktiengesellschaft

Imec

Eddy De Greef

Francky Catthoor

Geert Vanmeerbeeck

Hugo De Man

Bert Geelen

Paul Coene

Johan De Geyter

Bart Masschelein

Wilfried Verachtert

A virtual camera system comprises a plurality of physical cameras and a hardware setup miming software to create virtual viewpoints for the virtual camera system. The position of the physical cameras is constrained, where the main constraint is the overlap between the physical cameras. The present invention provides a method for creating a virtual viewpoint of a plurality of images captured by the plurality of cameras, the images comprising current frames and previous frames. The method comprises creating background frames by combining a set of previous frames; creating a plurality of foreground masks by performing segmentation on the plurality of current frames, the segmentation comprising separating foreground objects from background objects using the created background frames; extracting the foreground objects by AND-ing the plurality of current frames with the created plurality of foreground masks; rendering the foreground objects by using a three dimensional depth-box constrained viewpoint interpolation algorithm on the plurality of current frames, the three dimensional depth box being constructed for each foreground object by exploiting information from the created foreground masks and positioning information of the foreground objects; rendering a view-dependent background image by performing homographic transformations on the created background frames; and creating the virtual viewpoint by superimposing the rendered foreground objects on the rendered background frame.

Virtual camera system

The present invention provides a method and an apparatus for reducing the storage size required for temporary data by storage order optimization. Advantageously, the execution order optimization and the storage order optimization may be treated independently. The storage size optimization is preferably performed by determining an optimum intra-array and/or inter-array storage order based on a geometrical model. The geometrical model provides a representation of the address space occupied by an array as a function of time and allows the calculation of the window size of the occupied address/time domain of the array. Where calculations would be time-consuming, these may be shortened by making simplifying assumptions, e.g. calculation of upper and lower bounds of the window size of the occupied address/time domain of an array rather than an exact calculation. Further, heuristical simplifications are described to reduce run-times for the optimization process.

Method and apparatus for size optimization of storage units

Growing community of inventors

Erps-Kwerps, Belgium

Eddy De Greef