Fraunhofer-gesellschaft Zur Foerderung Der Angewandten Forschung E.v.

Frederik Zilly

Joachim Keinert

Peter Kauff

Marcus Bernd Mueller

Christian Riechert

Matthias Ziegler

Thomas Wittenberg

Andreas Ernst

Tobias Bergen

Christian Muenzenmayer

Michael Schoeberl

Oliver Schreer

Wolfgang Waizenegger

Michaela Benz

Malte Avenhaus

Christian MÜNZENMAYER

Marcus MÜLLER

Michael Schöberl

An apparatus comprises a first interface for receiving a plurality of partially overlapping images of an object from a corresponding plurality of cameras being arranged along a first and a second direction according to a camera pattern. The apparatus comprises an analyzing unit configured for selecting at least one corresponding reference point in an overlap area of a set of images, and for determining displacement information along the first and the second direction of the reference point in each of the other images of the set of images. A misalignment of the plurality of images along the first and the second direction is compensated by the displacement information so as to obtain aligned images. The apparatus comprises a determining unit configured for determining offset information between principal points of the plurality of cameras using at least three aligned images. The apparatus comprises a second interface for providing calibration data based on the displacement information and based on the offset information. The calibration data allows for calibrating the plurality of images so as to comply to the camera pattern.

Apparatus for providing calibration data, camera system and method for obtaining calibration data

Image processing device for producing in real-time a digital composite image from a sequence of digital images recorded by a camera device, in particular an endoscopic camera device, the image processing device including a selecting unit, a key point detection unit, a transforming unit and a joining unit, wherein the key point detection unit includes a maximum detection unit configured for executing following steps separately for the filter response for the reference image and for the filter response for the further image, wherein a variable threshold is used:i) creating blocks by dividing the respective filter response,ii) calculating the variable threshold for each of the blocks,iii) discarding those blocks of the blocks from further consideration, in which the respective filter response at a reference point of the respective block is less than the respective variable threshold.

Image processing device and method for producing in real-time a digital composite image from a sequence of digital images

The invention provides a light-field camera for capturing multiple views of a scene, representing samples of a light-field, having: a primary camera configured for capturing a primary digital two-dimensional image of the scene; a two-dimensional camera array having a plurality of secondary cameras, each of the secondary cameras being configured for capturing a secondary digital two-dimensional image of the scene to produce at least one set of secondary digital two-dimensional images of the scene; a semitransparent mirror arranged such that an incident light beam originating from the scene is split up in a first partial light beam, directed to the primary camera, and a second partial light beam, directed to the camera array; and a processing unit configured for receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and configured for computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corresponding to the primary digital two-dimensional image based on the set of secondary digital two-dimensional images.

Light-field camera

A filter structure for filtering a disparity map includes a first filter, a second filter, and a filter selector. The first filter is for filtering a contemplated section of the disparity map according to a first measure of central tendency. The second filter is for filtering the contemplated section of the disparity maps according to a second measure of central tendency. The filter selector is provided for selecting the first filter or the second filter for filtering the contemplated section of the disparity map, the selection being based on at least one local property of the contemplated section. A corresponding method for filtering a disparity map includes determining a local property of the contemplated section and selecting a filter. The contemplated section is then filtered using the first filter or the second filter depending on a result of the selection.

Spatio-temporal disparity-map smoothing by joint multilateral filtering

An apparatus for estimating a disparity map based on at least two images is provided. The apparatus includes at least two processing units, which include a pixel recursion unit configured to determine a disparity value as a pixel recursion disparity candidate based on a plurality of pixel values of the at least two images and a selector configured to select a selected disparity candidate to determine at least one of the disparity map values of the disparity map. The selector is adapted to select the selected disparity candidate from a candidate group assigned to the selector. The candidate group assigned to the selector includes the pixel recursion disparity candidate, a second disparity candidate and a third disparity candidate. Moreover, the selector is adapted to select the selected disparity candidate independently from a different selector of a different processing unit of the at least two processing units.

Apparatus and method for real-time capable disparity estimation for virtual view rendering suitable for multi-threaded execution

Growing community of inventors

Stuttgart, Germany

Frederik Zilly