Ouster, Inc.

Quanergy Systems, Inc.

Angus Pacala

Mark Frichtl

Marvin Liu Shu

Eric Younge

Louay Eldada

Daniel Lu

Kairen Wong

Tianyue Yu

Dmitri Garbuzov

Pierre Amelot

Mushfiqur Rouf

Henru Wang

Yan Zhao

Wil Selby

Boyi Ma

An optical measurement system may include a plurality of light sources and a plurality of photosensors, where the photosensors are configured to receive photons from the light sources that are reflected off objects in the surrounding environment. Photons may be stored in memory blocks corresponding to the photosensors to form histograms of the receive photons. A select circuit may be used to share memory blocks between photosensors, such that a plurality of photosensors may write to a single memory block, or a single photosensor may write to a plurality of memory blocks. Sampling clock cycles for the photosensors may be adjusted relative to the clock cycles for the memory blocks based on the select circuit output.

Configurable memory blocks for LIDAR measurements

A multispectral sensor array can include a combination of ranging sensor channels (e.g., LIDAR sensor channels) and ambient-light sensor channels tuned to detect ambient light having a channel-specific property (e.g., color). The sensor channels can be arranged and spaced to provide multispectral images of a field of view in which the multispectral images from different sensors are inherently aligned with each other to define an array of multispectral image pixels. Various optical elements can be provided to facilitate imaging operations. Light ranging/imaging systems incorporating multispectral sensor arrays can operate in rotating and/or static modes.

Multispectral ranging and imaging systems

A light ranging system including a shaft having a longitudinal axis; a light ranging device configured to rotate about the longitudinal axis of the shaft, the light ranging device including a light source configured to transmit light pulses to objects in a surrounding environment, and detector circuitry configured to detect reflected portions of the light pulses that are reflected from the objects in the surrounding environment and to compute ranging data based on the reflected portion of the light pulses; a base subsystem that does not rotate about the shaft; and an optical communications subsystem configured to provide an optical communications channel between the base subsystem and the light ranging device, the optical communications subsystem including one or more turret optical communication components connected to the detector circuitry and one or more base optical communication components connected to the base subsystem.

Rotating compact light ranging system

A LIDAR system can automatically determine, based on analysis of data collected from the sensor channels during operation, whether fog is present. If fog is present, the LIDAR system can operate in a fog mode, and if fog is not present, the LIDAR system can operate in a 'clear-air' mode. The two modes can differ from each other with respect to the emitter signals and/or the signal processing applied to the sensor data.

LIDAR system with fog detection and adaptive response

An optical system for collecting distance information within a field is provided. The optical system may include lenses for collecting photons from a field and may include lenses for distributing photons to a field. The optical system may include lens tubes that collimate collected photons, optical filters that reject normally incident light outside of the operating wavelength, and pixels that detect incident photons. The optical system may further include illumination sources that output photons at an operating wavelength.

Optical system for collecting distance information within a field

An optical measurement system may improve the accuracy with which it estimates distances to surrounding objects by upgrading various aspects of its data path. Spatial resolution may be increased by subdividing histogram buckets or integration registers based on spatial location. Saturation at any point in the data path can be detected and used to stop counting photons in individual pixels, which can then be normalized after a measurement is over. Multiple peaks can be detected using recursive or iterative techniques to identify a largest remaining peak at each stage. Instead of iterating through the histogram memory multiple times, a threshold can be pre-calculated based on an estimated ambient noise level, and peaks can be detected in a single pass.

Processing system for LIDAR measurements

A light ranging system can include a laser device and an imaging device having photosensors. The laser device illuminates a scene with laser pulse radiation that reflects off of objects in the scene. The reflections can vary greatly depending on the reflecting surface shape and reflectivity. The signal measured by photosensors can be filtered with a number of matched filter designed according to profiles of different reflected signals. A best matched filter can be identified, and hence information about the reflecting surface and accurate ranging information can be obtained. The laser pulse radiation can be emitted in coded pulses by allowing weights to different detection intervals. Other enhancements include staggering laser pulses and changing an operational status of photodetectors of a pixel sensor, as well as efficient signal processing using a sensor chip that includes processing circuits and photosensors.

Accurate photo detector measurements for LIDAR

An optical measurement system includes a photosensor that includes one or more photosensitive elements. Each of the photosensitive elements may generate signals when a photon is detected, and the number of photons detected for each photosensor may be accumulated in an integration register. The integration register may accumulate photon counts independent of a parallel data path that stores photon counts in time bins based on photon arrival times to form a histogram representation. The total photon count in the integration register can be used to estimate ambient background light and properly set signal thresholds for detecting reflected light signals represented in the histogram.

Independent per-pixel integration registers for LIDAR measurements

Embodiments describe a solid state electronic scanning LIDAR system that includes a scanning focal plane transmitting element and a scanning focal plane receiving element whose operations are synchronized so that the firing sequence of an emitter array in the transmitting element corresponds to a capturing sequence of a photosensor array in the receiving element. During operation, the emitter array can sequentially fire one or more light emitters into a scene and the reflected light can be received by a corresponding set of one or more photosensors through an aperture layer positioned in front of the photosensors. Each light emitter can correspond with an aperture in the aperture layer, and each aperture can correspond to a photosensor in the receiving element such that each light emitter corresponds with a specific photosensor in the receiving element.

Light ranging device having an electronically scanned emitter array

Optical systems and methods for collecting distance information are disclosed. An example optical system includes a first transmitting optic, a plurality of illumination sources, a pixel array comprising at least a first column of pixels and a second column of pixels, each pixel in the first column of pixels being offset from an adjacent pixel in the first column of pixels by a first pixel pitch, the second column of pixels being horizontally offset from the first column of pixels by the first pixel pitch, the second column of pixels being vertically offset from the first column of pixels by a first vertical pitch; and a set of input channels interposed between the first transmitting optic and the pixel array.

Methods and systems can augment 360 degree panoramic LIDAR results (e.g., from a spinning LIDAR system) with color obtained from color cameras. A color-pixel-lookup table can specify the correspondence between LIDAR pixels (depth/ranging pixels) and color pixels, which may be done at different viewing object distances. The operation of the color cameras can be triggered by the angular positions of the LIDAR system. For example, a color image of a particular camera can be captured when the LIDAR system is at a particular angular position, which can be predetermined based on properties of the cameras (e.g., shutter speed). Alternatively or in addition, a common internal clock can be used to assign timestamps to LIDAR and color pixels as they are captured. The corresponding color pixel(s), e.g., as determined using a color-pixel-lookup table, with the closest timestamp can be used for colorization.

Augmenting panoramic LIDAR results with color

A stereoscopic imager system, comprising: a sensor array comprising a first plurality of photosensors and a second plurality of photosensors spaced apart from the first plurality of photosensors by a gap, the first plurality of photosensors and the second plurality of photosensors being configured to detect ambient light in a scene; a moving component coupled to the sensor array and operable to move the sensor array between a first position and a second position within a full rotational image capturing cycle; and a system controller coupled to the sensor array and the moving component. The system controller can be configured to: move a field of view of a sensor array by instructing the moving component to capture a first image of an object in the scene with the first plurality of photosensors from a first perspective at the first position, and to capture a second image of the scene of the object in the scene with the second plurality of photosensors from a second perspective at the second position; and calculate, based on the first image and the second image, a distance to the object using an optical baseline defined by the gap.

Growing community of inventors

San Francisco, CA, United States of America

Angus Pacala