Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V.

Pelican Imaging Corporation

Fotonation Limited

Fotonation Cayman Limited

Aptina Imaging Corporation

Fresnel Optics Gmbh

Université De La Méditerranée - Aix-marseille II

Ecole Polytechnique Féderale De Lausanne (epfl)

Jacques Duparré

Kartik Venkataraman

Dan C Lelescu

Frank Wippermann

Errol Mark Rodda

Peter Dannberg

Andreas Braeuer

Andreas Brückner

Andreas Brueckner

Andreas Bräuer

Alexander Oberdörster

Steven David Oliver

Peter Schreiber

Andreas Tünnermann

Alexander Oberdoerster

Martin Punke

Martin Bitzer

Peter Schrelber

Andreas BRÜCKNER

Reinhard Völkel

Philipp SCHMÄLZLE

Stephane Viollet

Nicolas Franceschini

Jean-Christophe Zufferey

Dario Floreano

Franck Ruffier

A device includes a plurality of imaging optical channels inclined in relation to one another, each of which includes an optic and at least one detector pixel arrangement. The plurality of optical channels are configured to obtain an image of a dot pattern of a field of view by imaging said field of view. The optical channels pass through the display plane and are set up for imaging (projecting) the field of view between the display pixels. The device includes an evaluator that is coupled to detector pixels of the detector pixel arrangements and configured to evaluate the dot pattern on the basis of a comparison, which causes hyper resolution, of signal intensities of different detector pixels so as to obtain an evaluation result, and to control the device at least partly on the basis of the evaluation result.

Device and method of capturing a projected dot pattern in a display device

A multi-aperture imaging device includes image sensor means with a plurality of image sensor areas and a plurality of optical channels, wherein each optical channel includes an optic for imaging a partial field of view of a total field of view onto an image sensor area of the image sensor means associated with the optical channel. The plurality of optical channels is configured to image the total field of view completely. A first partial field of view of the total field of view and a second partial field of view of the total field of view are captured by a different number of optical channels.

Multi-channel imaging device and device having a multi-aperture imaging device

An inventive device includes a multi-aperture imaging device comprising an image sensor; an array of adjacently arranged optical channels, each optical channel including an optic for projecting at least one partial field of view of a total field of view onto an image sensor area of the image sensor arrangement, a beam deflection means for deflecting an optical path of the optical channels, and a focusing means for setting a focal position of the multi-aperture imaging device. The device further comprises a control means configured to control the focusing means and to receive image information from the image sensor; the control means being configured to control the multi-aperture imaging device into a sequence of focal positions so as to capture a corresponding sequence of image information of the total field of view and to produce, from the sequence of image information, a depth map for the captured total field of view.

Device comprising a multi-aperture imaging device for generating a depth map

An inventive device includes a multi-aperture imaging device having an image sensor; an array of adjacently arranged optical channels, each optical channel including optics for projecting at least one partial field of view of a total field of view on an image sensor area of the image sensor, a beam deflector for deflecting a beam path of the optical channels, and focusing means for setting a focal position of the multi-aperture imaging device. The device further includes control means configured to control the focusing means and to receive image information from the image sensor; wherein the control means is configured to control the focusing means and to receive image information from the image sensor; wherein the control means is configured to set a sequence of focal positions in the multi-aperture imaging device so as to detect a corresponding sequence of image information of the total field of view, and to create a depth map for the detected total field of view on the basis of the sequence of image information.

A multi-aperture imaging device is provided that includes an image sensor and an array of adjacently arranged optical channels. Each optical channel includes an optic for imaging at least one partial field of view of a total field of view onto an image sensor area of the image sensor. The device has a beam-deflector for deflecting an optical path of the optical channels and the beam-deflector includes a first beam-deflecting area operative for a first wavelength range of electromagnetic radiation passing through the optical channel; and a includes second beam-deflecting area operative for a second wavelength range of the electromagnetic radiation passing through the optical channels. The second wavelength range is different from the first wavelength range.

Multi-aperture imaging device with a wavelength-specific beam deflector and device having such a multi-aperture imaging device

Systems and methods for estimating depth from projected texture using camera arrays are described. A camera array includes a conventional camera and at least one two-dimensional array of cameras, where the conventional camera has a higher resolution than the cameras in the at least one two-dimensional array of cameras, an illumination system configured to illuminate a scene with a projected texture, where an image processing pipeline application directs the processor to: utilize the illumination system controller application to control the illumination system to illuminate a scene with a projected texture, capture a set of images of the scene illuminated with the projected texture, and determining depth estimates for pixel locations in an image from a reference viewpoint using at least a subset of the set of images.

Systems and methods for estimating depth from projected texture using camera arrays

A multi-aperture imaging device includes an array of optical channels, wherein each optical channel includes optics for imaging a partial field of view of a total field of view onto an image sensor region of an image sensor. The multi-aperture imaging device includes a beam-deflecting unit for deflecting an optical path of the optical channels to a viewing direction of the multi-aperture imaging device. The multi-aperture imaging device includes a diaphragm structure arranged to at least partly close a gap between the array and the beam-deflecting unit.

Multi-aperture imaging device of low stray light sensitivity, imaging system and method for providing a multi-aperture imaging device

A device includes an image sensor and an array of optical channels, each optical channel including an optic for projecting a partial field of view of a total field of view onto an image sensor area of the image sensor. A first optical channel of the array is configured to image a first partial field of view of the total field of view. A second optical channel of the array is configured to image a second partial field of view of the total field of view. The device includes a calculating unit configured to obtain image information of the first and second partial fields of view on the basis of the imaged partial fields of view, and to obtain image information of the total field of view, and to combine the image information of the partial fields of view with the image information of the total field of view so as to generate combined image information of the total field of view.

Device for imaging partial fields of view, multi-aperture imaging device and method of providing same

A device includes a multi-aperture imaging device having an image sensor; an array of adjacently arranged optical channels, and a beam deflector for deflecting a beam path of the optical channels, wherein a relative position of the beam deflector is switchable between first and second positions so that in the first and second positions, the beam path is deflected towards first and second total fields of view, respectively. The device further includes controller adapted to control the beam deflector to move to the first and second positions to obtain imaging information of the first and second total fields of view, respectively, from the image sensor; and to insert a portion of the first imaging information into the second imaging information so as to obtain accumulated image information that in parts represents the first total field of view and in parts represents the second total field of view.

Device comprising a multi-aperture imaging device for accumulating image information

What is described are a method and a device, wherein two types of individual images are captured, namely a set of individual images captured simultaneously, and a further set of individual images captured in temporal succession. Among said two sets of individual images, individual images are selected which in combination result in a panoramic image.

Generating panoramic images

A multi-aperture imaging device includes an image sensor and an array of optical channels, wherein each optical channel includes an optic for imaging at least a part of a total field of view onto an image sensor region of the image sensor. The multi-aperture imaging device includes a beam-deflector including at least one beam-deflecting element for deflecting an optical path of an optical channel, wherein each optical channel is assigned a beam-deflecting element. The beam-deflecting element is configured to have a transparent state of a controllable surface based on first electric control and to have a reflecting state of the controllable surface based on a second electric control in order to deflect the optical path.

Multi-aperture imaging device, imaging system and method for providing a multi-aperture imaging device

A multi-aperture imaging device includes an image sensor and an array of optical channels, wherein each optical channel includes an optic for projecting a partial field of view of a total field of view on an image sensor area of the image sensor. The multi-aperture imaging device includes a beam-deflecting unit for deflecting an optical path of the optical channels, and an optical image stabilizer for the image stabilization along a first image axis by generating a first translational relative movement between the image sensor and the array and the beam-deflecting unit and for the image stabilization along a second image axis by generating a second relative movement between the image sensor, the array and the beam-deflecting unit. The device includes an electronic image stabilizer for the image stabilization of a first optical channel of the array along the first and the second image axis.

Multi-aperture imaging device, imaging system and method for making available a multi-aperture imaging device

A multi-aperture imaging device includes an image sensor and array of optical channels, wherein each optical channel includes optics for projecting at least one partial field of view of a total field of view on an image sensor area of the image sensor. The multi-aperture imaging device includes a beam deflector for deflecting an optical path of the optical channels. A first optical channel of the array is configured to image a first partial field of view of a first total field of view, wherein a second optical channel of the array is configured to image a second partial field of view of the first total field of view. A third optical channel is configured to completely image a second total field of view. The second total field of view is an incomplete section of the first total field of view.

Multi-aperture imaging device, imaging system and method of providing a multi-aperture imaging device

Systems and methods in accordance with embodiments of the invention estimate depth from projected texture using camera arrays. One embodiment of the invention includes: at least one two-dimensional array of cameras comprising a plurality of cameras; an illumination system configured to illuminate a scene with a projected texture; a processor; and memory containing an image processing pipeline application and an illumination system controller application. In addition, the illumination system controller application directs the processor to control the illumination system to illuminate a scene with a projected texture. Furthermore, the image processing pipeline application directs the processor to: utilize the illumination system controller application to control the illumination system to illuminate a scene with a projected texture capture a set of images of the scene illuminated with the projected texture; determining depth estimates for pixel locations in an image from a reference viewpoint using at least a subset of the set of images. Also, generating a depth estimate for a given pixel location in the image from the reference viewpoint includes: identifying pixels in the at least a subset of the set of images that correspond to the given pixel location in the image from the reference viewpoint based upon expected disparity at a plurality of depths along a plurality of epipolar lines aligned at different angles; comparing the similarity of the corresponding pixels identified at each of the plurality of depths; and selecting the depth from the plurality of depths at which the identified corresponding pixels have the highest degree of similarity as a depth estimate for the given pixel location in the image from the reference viewpoint.

Systems and methods for implementing array camera configurations that include a plurality of constituent array cameras, where each constituent array camera provides a distinct field of view and/or a distinct viewing direction, are described. In several embodiments, image data captured by the constituent array cameras is used to synthesize multiple images that are subsequently blended. In a number of embodiments, the blended images include a foveated region. In certain embodiments, the blended images possess a wider field of view than the fields of view of the multiple images.

Growing community of inventors

Jena, Germany

Jacques Duparré