Qualcomm Incorporated

Ati Technologies Ulc

Ati Technologies Inc.

Sergiu Radu Goma

Kalin Mitkov Atanassov

Milivoje M Aleksic

Biay-Cheng Hseih

Todor Georgiev Georgiev

Jian Jim Ma

James Wilson Nash

Vikas Ramachandra

Thomas Wesley Osborne

Fariborz Pourbigharaz

Jiafu Luo

Hau Hwang

Joseph Cheung

Hasib Siddiqui

Stephen Michael Verrall

Albrecht Johannes Lindner

Judit Martinez Bauza

Andrzej Mamona

Venkata Ravi Kiran Dayana

Karthikeyan Shanmugavadivelu

Narayana Karthik Sadanandam Ravirala

Shen-Ge Wang

Robert Mitchell Kleiman

Wen-Yu Sun

Zheng-wu Li

Daniel Moses

Maxim Smirnov

Sergio Lopez

Millivoje Aleksic

Hasib Ahmed Siddiqui

A method performed by an electronic device is described. The method includes obtaining a first image from a first camera, the first camera having a first focal length and a first field of view. The method also includes obtaining a second image from a second camera, the second camera having a second focal length and a second field of view disposed within the first field of view. The method further includes aligning at least a portion of the first image and at least a portion of the second image to produce aligned images. The method additionally includes fusing the aligned images based on a diffusion kernel to produce a fused image. The diffusion kernel indicates a threshold level over a gray level range. The method also includes outputting the fused image. The method may be performed for each of a plurality of frames of a video feed.

Systems and methods for fusing images

Techniques and systems are provided for high resolution time-of-flight (ToF) depth imaging. In some examples, an apparatus includes a projection system including one or more light-emitting devices, each light-emitting device being configured to illuminate at least one portion of an entire field-of-view (FOV) of the projection system. The entire FOV includes a plurality of FOV portions. The apparatus also includes a receiving system including a sensor configured to sequentially capture a plurality of images based on a plurality of illumination reflections corresponding to light emitted by the one or more light-emitting devices. Each image of the plurality of images corresponds to one of the plurality of FOV portions. An image resolution associated with each image corresponds to a full resolution of the sensor. The apparatus further includes a processor configured to generate, using the plurality of images, an increased resolution depth map associated with the entire FOV.

High resolution time-of-flight depth imaging

Aspects of the present disclosure relate to depth sensing using a device. An example device includes a light projector configured to project light in a first and a second distribution. The first and the second distribution include a flood projection when the device operates in a first mode and a pattern projection when the device operates in a second mode, respectively. The example device includes a receiver configured to detect reflections of light projected by the light projector. The example device includes a processor connected to a memory storing instructions. The processor is configured to determine first depth information based on reflections detected by the receiver when the device operates in the first mode, determine second depth information based on reflections detected by the receiver when the device operates in the second mode, and resolve multipath interference (MPI) using the first depth information and the second depth information.

Resolving multipath interference using a mixed active depth system

Aspects of the present disclosure relate to depth sensing using a device. An example device includes a first light projector configured to project light towards a second light projector configured to project light towards the first light projector. The example device includes a reflective component positioned between the first and second light projectors, the reflective component configured to redirect the light projected by the first light projector onto a first portion of a scene and to redirect the light projected by the second light projector onto a second portion of the scene, and the first and second portions of the scene being adjacent to one another and non-overlapping relative to one another. The example device includes a receiver configured to detect reflections of redirected light projected by the first and second light projectors.

Wide-angle 3D sensing

Systems and techniques are described for large field of view digital imaging. A device's first image sensor captures a first image based on first light redirected from a first path onto a redirected first path by a first light redirection element, and the device's second image sensor captures a second image based on second light redirected from a second path onto a redirected second path by a second light redirection element. A virtual extension of the first path beyond the first light redirection element can intersect with a virtual extension of the second path intersect beyond the second light redirection element. The device can modify the first image and second image using perspective distortion correction, and can generate a combined image by combining the first image and the second image. The combined image can have a larger field of view than the first image and/or the second image.

Multiple camera system for wide angle imaging

A method and device is provided that compensates for different reflectivity/absorption coefficients of objects in a scene/object when performing active depth sensing using structured light. A receiver sensor captures an image of a scene onto which a code mask is projected. One or more parameters are ascertained from the captured image. Then a light source power for a projecting light source is dynamically adjusted according to the one or more parameters to improve decoding of the code mask in a subsequently captured image. Depth information for the scene may then be ascertained based on the captured image based on the code mask. In one example, the light source power is fixed at a particular illumination while an exposure time for the receiver sensor is adjusted. In another example, an exposure time for the receiver sensor is maintained/kept at a fixed value while the light source power is adjusted.

Dynamic adjustment of light source power in structured light active depth sensing systems

Aspects of the present disclosure relate to an image sensor. An example apparatus includes an image sensor including one or more pixels. Each pixel of the one or more pixels includes a photodetector, and the photodetector includes a photosensitive surface including germanium. In some implementations, the photodetector includes a photodiode including an intrinsic silicon layer doped with germanium or including germanium crystals. The intrinsic layer may be between a p&#x2212; layer and an n&#x2212; layer not including germanium. The intrinsic layer may be configured to absorb photons of the light received at the intrinsic layer. The light may include one or more reflections of an emitted light for active depth sensing. For example, the emitted light may be frequency modulated and having a first wavelength for indirect time-of-flight depth sensing. Sampling circuits may generate voltages indicating a phase difference between the emitted light and a reflection of the emitted light.

Active depth sensing image sensor

This disclosure provides systems, methods, and apparatuses for sensing a scene. In one aspect, a device may illuminate the scene using a sequence of two or more periods. Each period may include a transmission portion during which a plurality of light pulses are emitted onto the scene. Each period may include a non-transmission portion corresponding to an absence of emitted light. The device may receive, during each transmission portion, a plurality of light pulses reflected from the scene. The device may continuously accumulate photoelectric charge indicative of the received light pulses during an entirety of the sequence. The device may transfer the accumulated photoelectric charge to a readout circuit after an end of the sequence.

3D active depth sensing with laser pulse train bursts and a gated sensor

A high dynamic range solid state image sensor and camera system are disclosed. In one aspect, the solid state image sensor includes a first wafer including an array of pixels, each of the pixels comprising a photosensor, and a second wafer including an array of readout circuits. Each of the readout circuits is configured to output a readout signal indicative of an amount of light received by a corresponding one of the pixels and each of the readout circuits includes a counter. Each of the counters is configured to increment in response to the corresponding photosensor receiving an amount of light that is greater than a photosensor threshold. Each of the readout circuits is configured to generate the readout signal based on a value stored in the corresponding counter and a remainder stored in the corresponding pixel.

High dynamic range solid state image sensor and camera system

Various embodiments are directed to an image sensor that includes a first sensor portion and a second sensor portion. The second sensor portion may be positioned relative to the first sensor portion such that the second sensor portion may initially detect light entering the image sensor, and some of that light passes through the second sensor portion and may be detected by the first sensor portion. In some embodiments, one more optical filters may be disposed within the image sensor. The one or more optical filters may include at least one of a dual bandpass filter disposed above the second photodetector or a narrow bandpass filter disposed between the first photodetector and the second photodetector.

Solid state image sensor with on-chip filter and extended spectral response

Aspects relate to digital imaging. An example method includes receiving a first image frame of a scene captured by a first image sensor. The method also includes receiving a second image frame of the scene captured by a second image sensor. The second image frame is captured concurrently with capture of the first image frame. The method also includes receiving a third image frame of the scene captured by a third image sensor. The third image frame is captured concurrently with capture of the first image frame. The method also includes generating a combined image from the first image frame, the second image frame, and the third image frame. The combined image includes a first field of view that is wider than a field of view of the first image frame.

Aspects of the present disclosure relate to systems and methods for active depth sensing. An example device includes a light projector. The light projector includes a light source to emit light and a diffractive element. The diffractive element is configured to receive the emitted light that is polarized, project a first distribution of light when the received light has a first polarity, and project a second distribution of light when the received light has a second polarity.

Adjustable light distribution for active depth sensing systems

Aspects of the present disclosure relate to a device for active depth sensing with an adjustable distribution of light projected. An example device includes a light projector. The light projector includes a light source configured to emit a light and a diffractive element. The diffractive element includes a first diffractive optical element having a first refractive index and configured to project a first distribution of light, a second diffractive optical element having a second refractive index and configured to project a second distribution of light based on a refractive material between the first diffractive optical element and the second diffractive optical element, and the refractive material located between the first diffractive optical element and the second optical element. The refractive material is adjustable to have a second refractive index for the first mode and a third refractive index for the second mode.

Aspects of the present disclosure relate to an adjustable light projector for active depth sensing and flood illumination. An example device includes a light projector that includes a light source to emit a light along a first direction and a diffractive element positioned in a path of the emitted light along the first direction. The diffractive element includes a diffractive optical element having a first refractive index and configured to project a distribution of focused light from the emitted light during a first mode. The diffractive element also includes a diffusion element having a second refractive index and configured to diffuse the emitted light during a second mode.

Growing community of inventors

San Diego, CA, United States of America

Sergiu Radu Goma