Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V.

Peter Eisert

Peter Kauff

Anna Hilsmann

Thomas Schierl

Cornelius Hellge

Robert Philipp Skupin

Oliver Schreer

Ingo Feldmann

Wolfgang Waizenegger

Gurdeep Singh Bhullar

Yago Sánchez De La Fuente

Dimitri Podborski

Serhan Gül

Arne Finn

Nicole Atzpadin

Christian Weissig

Eric Wisotzky

Joachim Schuessler

Wieland Morgenstern

Jangwoo Son

A data stream having volumetric video data encoded therein in a scene description language, the data stream representing a scene comprising one or more objects is disclosed, wherein the data stream comprises for at least one object first mesh data, second mesh data and correspondence information, wherein the first mesh data describes the at least one object with a first mesh, the second mesh data describes the at least one object with a second mesh, and wherein the correspondence information indicates a mapping between the first and second mesh. Devices, Methods and a computer program product are also described.

Data stream, devices and methods for volumetric video data

A method of augmenting a view of a real-world environment with a view of a volumetric video object on a user device is disclosed. The method includes determining a current pose information (CPI) indicating a current pose of the view of the real-world environment and a desired pose of the volumetric video object in the real-world environment. The method further includes sending the CPI to a remote server. The method further includes receiving a rendered view of the volumetric video object that has been rendered in accordance with the CPI from the remote server. The method also includes augmenting the view of the real-world environment by at least mapping the rendered view of the volumetric video object onto a planar mapping surface arranged according to the desired position of the volumetric video object.

Augmenting a view of a real-world environment with a view of a volumetric video object

A medical imaging device, comprising a illumination unit, can be configured to illuminate a tissue area with light from a first spectral range, comprising a range of visible wavelengths, and with light from a second spectral range, which is different from the first spectral range, an imaging unit, configured to detect light from the first spectral range and to generate a first image of the tissue area on the basis of the detected light from the first spectral range and furthermore configured to detect light from the second spectral range and to generate a second image of the tissue area on the basis of the detected light from the second spectral range, and a superposition unit, configured to generate a superimposed image on the basis of the first and second image in such a way that, in the superimposed image, on the basis of a visual highlighting, it is possible to identify whether and where the tissue area comprises highlight regions which are characterized by an increased emission of light from the second spectral range in comparison to other regions of the tissue area. The document furthermore relates to a method for image-based support for a medical intervention, and to a use of an imaging device in such a method.

Medical imaging device, method, and use

An apparatus for performing 3D estimation on the basis of pictures of at least two different views includes a hypotheses provider, a similarity measure calculator, and a 3D information determiner. The hypotheses provider locally determines 3D information hypotheses for positions of a current picture of a first view on the basis of a pre-estimate which associates a 3D information estimate to each position of a picture of the first view. The similarity measure calculator calculates, for each position of the current picture of the first view, a hypotheses of the respective position by measuring a similarity between a region similarity measure for each of the 3D information of the current picture of the first view at the respective position and a corresponding region of a second view at a position displaced relative to the respective position by a respective 3D information hypothesis. The 3D information determiner selects, for each position of the first view, the 3D information hypothesis of highest similarity measure.

Apparatus and method for performing 3D estimation based on locally determined 3D information hypotheses

A method for generating 3D-information from multiple images showing a 3D scene from multiple perspectives has: providing at least two hypotheses for the 3D-information; performing a multi-hypotheses test by matching the at least two hypotheses to the multiple images and determining a test-result hypothesis that fulfills a particular matching criterion; updating the test-result hypothesis by varying a parameter set of the test-result hypothesis to further improve the matching criterion or another criterion; and determining the 3D-information on the basis of the parameter set of a resulting hypothesis provided by the action of updating the test-result hypothesis. A corresponding computer readable digital storage medium and a 3D-information generator are also described. Further embodiments perform a correspondence analysis between projections of spatio-temporal objects (STO) in multiple images to select a particular spatio-temporal object on the basis of said correspondence analysis.

Hybrid recursive analysis of spatio-temporal objects

A provision of high quality panoramic or semi-panoramic 3D scenes is achieved at reasonable efforts by arranging the plurality of camera pairs, each of which is associated with a respective one of mirror plane surfaces of a pyramid or clipped-pyramid shaped mirror in that same is directed towards the respective associated mirror plane surface, such that for each camera pair the virtual positions of pivot points of the cameras of the respective camera pair are offset from each other along a straight baseline which, in turn, is offset from the axis of the mirror, and a distance between virtual points of a left-hand channel camera of a first camera pair associated with a first mirror plane surface and a right-hand channel camera of a second camera pair associated with a second mirror plane surface positioned neighboring the first mirror plane surface, deviates from a length of the baselines of the camera pairs by less than 10% of the length of the baselines.

Capturing panoramic or semi-panoramic 3D scenes

Growing community of inventors

Berlin, Germany

Peter Eisert