Apple Inc.

Adeia Semiconductor Bonding Technologies Inc.

Primesense Ltd

Daniel Cohen

Erez Sali

Alexander Shpunt

Gerard Medioni

Ronen Deitch

Noy Cohen

Oded Gigushinski

Shahar Kovalsky

Alexandru Drimbarean

Dmitri Rais

Niv Galezer

Yariv Oz

Poitr Stec

Dmitry Rais

Yariz Oz

Avi Amramy

A method for depth mapping includes receiving optical radiation reflected from multiple points on an object and processing the received optical radiation to generate depth data including multiple candidate depth coordinates for each of a plurality of pixels and respective measures of confidence associated with the candidate depth coordinates. One of the candidate depth coordinates is selected at each of the plurality of the pixels responsively to the respective measures of confidence. A depth map of the object is output, including the selected one of the candidate depth coordinates at each of the plurality of the pixels.

Multi-modal depth mapping

A method for depth mapping includes acquiring first depth data with respect to an object using a first depth mapping technique and providing first candidate depth coordinates for a plurality of pixels, and acquiring second depth data with respect to the object using a second depth mapping technique, different from the first depth mapping technique, and providing second candidate depth coordinates for the plurality of pixels. A weighted voting process is applied to the first and second depth data in order to select one of the candidate depth coordinates at each pixel. A depth map of the object is output, including the selected one of the candidate depth coordinates at each pixel.

A method for depth mapping includes projecting a pattern of optical radiation onto an object. A first image of the pattern on the object is captured using a first image sensor, and this image is processed to generate pattern-based depth data with respect to the object. A second image of the object is captured using a second image sensor, and the second image is processed together with another image to generate stereoscopic depth data with respect to the object. The pattern-based depth data is combined with the stereoscopic depth data to create a depth map of the object.

Depth mapping based on pattern matching and stereoscopic information

A method for forming a three-dimensional (3D) map of an object, including illuminating the object from a light source so as to project a pattern onto the object, capturing an image of the pattern using an array of detector elements, and processing the captured image so as to measure respective offsets of elements of the pattern in the captured image relative to a reference pattern, the offsets including at least a first offset of a first element of the pattern and a second offset of a second element of the pattern, measured respectively in first and second, mutually-perpendicular directions in a plane of the array. The method further includes computing a correction factor in response to the first offset, applying the correction factor to the second offset so as to find a corrected offset, and computing depth coordinates of the object in response to the corrected offset.

Error compensation in three-dimensional mapping

A method for depth mapping includes capturing an electronic image of a scene using an imaging device. The electronic image is processed to generate depth data with respect to the scene. The gain of the imaging device is set responsively to the depth data.

Depth-based gain control

A forward interpolation approach is disclosed for enabling a second version of an image to be constructed from a first version of the image. According to one implementation of the forward interpolation approach, pixels from the first version of the image are processed one row at a time. As the pixels in a row of pixels in the first version of the image are processed, they may cause pixel values on different rows of the second version of the image to be determined. Since the pixel values of the second version of the image are stored in output line buffers, this means that, at any particular point in time, there may be multiple partially filled output line buffers. It has been observed that the forward interpolation approach enables significant benefits (such as reduced storage requirements and reduced internal bandwidth and processing) to be achieved over a backward interpolation approach.

Forward interpolation approach for constructing a second version of an image from a first version of the image

A forward interpolation approach is disclosed for enabling a second version of an image to be constructed from a first version of the image. According to one implementation, an input pixel from the first version of the image is forward mapped to the second version of the image to determine a set of candidate pixels that may be affected by the input pixel. Each candidate pixel is then backward mapped to the first version of the image to determine whether they are actually affected by the input pixel. For each candidate pixel that is actually affected by the input pixel, a pixel value is determined for that candidate pixel based at least in part upon the pixel value of the input pixel. By using this forward and backward mapping technique, forward interpolation can be implemented quickly and efficiently.

Growing community of inventors

Tel Aviv, Israel

Daniel Cohen