Spectricity

Imec Vzw

Maarten De Bock

Jonathan Borremans

Ward Van Der Tempel

Jakub Raczkowski

Ruben Lieten

Jan Craninckx

Jeroen Hermans

A system for imaging includes an array of optical sensors having a respective top surface and a respective bottom surface and a first plurality of sets of optical filters, each set of optical filters of the first plurality of sets of optical filters being associated with a respective set of optical sensors of the array. The system further includes a second plurality of sets of optical filters, each set of optical filters of the second plurality of sets of optical filters being associated with a respective set of optical sensors of the array, each optical filter of a set of optical filters of the second plurality of sets of optical filters configured to pass light of a respective wavelength range, where the second plurality of sets of optical filters are interspersed spatially across the top surface of the array of optical sensors. Finally, the system includes one or more processors adapted to sample an image of a scene based on an output from a first plurality of sets of optical sensors of the array and sample a received light spectrum for each set of optical sensors of a second plurality of sets of optical sensors of the array.

Imaging system using spatially separated spectral arrays

A sensor system includes a plurality of optical sensors implemented in a pixel layer of an integrated circuit and a plurality of sets of optical filters implemented proximal to the pixel layer in a plurality of alternating filter layers. An optical filter of a set of optical filters includes a plurality of filter components implemented in a stack and is configured to pass a respective target wavelength range of light to one or more optical sensors of the plurality of optical sensors. One or more filter components of the plurality of filter components in a filter layer of the plurality of filter layers is common to a plurality of optical filters of a set of optical filters.

Hyperspectral filter structure and method of manufacture

A method begins by generating a received light spectrum at time T1 for a scene using a spectral imager that includes a plurality of spectral sensors, where a spectral sensor includes a spectral filter overlaying one or more first optical sensors and the sensing range for the plurality of spectral sensors together include a spectrum of wavelength and outputting information representative of a spectral image for the scene at T1 to a processing module. The method continues by using an image sensor to image the scene at time T2, where the image sensor includes a plurality of second optical sensors, and outputting information representative of an image of the scene at T2 to the processing module where the image of the scene has a spatial resolution that is higher than the spatial resolution of the spectral image. The method continues by producing a combined spectral image based on the information representative of a spectral image for the scene at T1 and the information representative of the image at T2 and correcting, based on the combined spectral image, an illuminant for one or more spatial areas of the scene to produce a corrected spectral image.

Illuminant correction in an imaging system

An optical sensor system comprises an array of optical sensors arranged on an integrated circuit and a plurality of filters with the bottom surface of the plurality of filters located above the top surface of the array of optical sensors. The optical sensor system further comprises an angle-of-incidence layer that includes a top surface, a bottom surface, and a thickness Y, where the bottom surface of the angle-of-incidence layer is located a predetermined distance X from the top surface of the plurality of filters and the angle-of-incidence layer includes a plurality of collimating elements, with each collimating element of the angle-of-incidence layer having an aperture width Z.

Collimating array for an optical sensing device

An imaging system includes a plurality of optical sensors arranged on an integrated circuit in an array with a plurality of rows and a plurality of columns. The system includes an interface communicating with the plurality of optical sensors, memory storing operational instructions and processing circuitry configured to sample an image using the plurality of optical sensors in a first mode and sample at least a portion of the image sequentially on a row-by-row basis at a predetermined sampling rate in a second mode to produce row by row sample outputs. The processing circuitry is further configured to initiate sampling at least some rows of the plurality of rows of optical sensors using different time stamps.

Detection of light source distortion in an imaging system

A sensor system includes an array of optical sensors on an integrated circuit and a plurality of sets of optical filters atop at least a portion of the array. Each set of optical filters is associated with a set of optical sensors of the array, with a set of optical filters including a plurality of optical filters, with each optical filter being configured to pass light in a different wavelength range. A first interface is configured to interface with the optical sensors and first processing circuitry that is configured to execute operational instructions for receiving an output signal representative of received light from the optical sensors and determining a spectral response for each set of optical sensors. A second interface is configured to interface with the first processing circuitry with second processing circuitry that is configured for determining, based on the spectral response for each set of optical sensors, an illuminant spectrum for each spectral response and then substantially remove the illuminant spectrum from the spectral response.

Illuminant correction for a spectral imager

An optical sensor system includes a plurality of sets of optical sensors implemented on a substrate, with a plurality of sets of optical filters, wherein a set of optical filters of the plurality of sets of optical filters is associated with a set of optical sensors and a set of optical filters of the plurality of sets of optical filters includes a plurality of optical filters that are arranged in a pattern, with each optical filter of the plurality of optical filters configured to pass light in a different wavelength range of a predefined spectral range. Each set of optical filters operates to provide a bandpass response corresponding to the predefined spectral range and a set of optical filters is located atop an associated set of optical sensors, where at least two sets of optical filters of the plurality of sets of optical filters are configured to provide different bandpass responses. An optical element is associated with a corresponding set of optical sensors, with each rejection filter configured to pass light wavelengths in a predefined spectral range.

Spectral sensor system using optical filter subarrays

A system for imaging a scene, includes a plurality of optical sensors arranged on an integrated circuit and a plurality of sets of interference filters, where each set of interference filters of the plurality of sets of interference filters includes a plurality of interference filters that are arranged in a pattern and each interference filter of the plurality of filters is configured to pass light in a different wavelength range, where each set of interference filters of the plurality of interference filters is associated with a spatial area of the scene. The system includes a plurality of rejection filters arranged in a pattern under each set of interference filters, where each rejection filter of the plurality of rejection filters is configured to substantially reject light of predetermined wavelengths. The system further includes one or more processors adapted to provide a spectral response for a spatial area of the scene associated with the set of interference filters.

White balance compensation using a spectral sensor system

A sensor system comprises a plurality of sets optical sensors arranged on an integrated circuit, the plurality of sets optical sensors having a respective top surface. The sensor system further comprising an interface between the plurality of optical sensors and a processing device configured to transmit information there between and an array of optical filters having a respective bottom surface and a respective top surface, where the bottom surface of the optical filter array is located proximal to the top surface of the plurality of sets optical sensors and each optical filter of the optical filter array is configured to pass a target wavelength range of light to a set of optical sensors. The processor is configured to receive an output from each optical sensor in a set of optical sensors and determine a corrected filter response for the set of optical sensors using crosstalk from light transmitted through optical filters adjacent to the set of optical sensors.

Spectral sensor system with spatially modified center wavelengths

An spectral sensor system includes an array of optical sensors arranged on an integrated circuit, an interface between the plurality of optical sensors and a first processing device, a plurality of sets of optical filters configured as a layer located atop the plurality of optical sensors, with each set of optical filters including a plurality of optical filters, each optical filter configured to pass light in a different wavelength range. The spectral sensor system includes a memory configured to interface with the first processing device, the memory configured to store calibration data associated with the plurality of sets of optical sensors. The spectral sensor system further includes second processing device includes an artificial neural network configured to correct a spectral response generated by the plurality of optical sensors and an interface between the first processing device and the second processing device is configured to transmit information therebetween.

Correction and calibration of spectral sensor output

A circuit and a method for converting an analog signal to a digital value representation is disclosed. In one aspect, the circuit includes an incremental sigma-delta analog-to-digital converter (ADC). The circuit further includes a first input line for providing a primary analog signal representing a sensor measurement to the incremental sigma-delta ADC. The circuit further includes a second input line for providing a secondary analog signal to the incremental sigma-delta ADC. The incremental sigma-delta ADC receives the primary and secondary analog signals during a first period (T) and a second period (T), respectively. The circuit further includes a filter configured to weight the digital values in a sequence of digital values output by the incremental sigma-delta ADC, and to output a single digital value representing the sensor measurement.

Growing community of inventors

Ghent, Belgium

Maarten De Bock