Massachusetts Institute of Technology

Anduril Industries, Inc.

Other

Michael W Kelly

Curtis Colonero

Christopher David

Lawrence M Candell

Daniel Allan Mooney

Megan H Blackwell

James Wey

Robert P Berger

Brian M Tyrrell

Kenneth I Schultz

Justin Baker

Joseph Costa

William Ross

Lauren L White

Joseph Bari

Joseph H Lin

Ralph Hamilton Shepard, Iii

A computational pixel imaging device that includes an array of pixel integrated circuits for event-based detection and imaging. Each pixel may include a digital counter that accumulates a digital number, which indicates whether a change is detected by the pixel. The counter may count in one direction for a portion of an exposure and count in an opposite direction for another portion of the exposure. The imaging device may be configured to collect and transmit key frames at a lower rate, and collect and transmit delta or event frames at a higher rate. The key frames may include a full image of a scene, captured by the pixel array. The delta frames may include sparse data, captured by pixels that have detected meaningful changes in received light intensity. High speed, low transmission bandwidth motion image video can be reconstructed using the key frames and the delta frames.

Event-based computational pixel imagers

A computational pixel imaging device can include multiple digitizing counters per pixel that can be used to execute simultaneous signal-processing threads on acquired image data. The imaging device can also include infinite dynamic range sensing and perform signal down-sampling.

Advanced computational pixel imagers with multiple in-pixel counters

A computational pixel imaging device can include multiple counters per pixel that can be used to acquire in-pixel histogram data representative of a signal detected by a pixels detector. Multiple pixel counters can also be used to execute simultaneous signal-processing threads on acquired image data. The imaging device can also include infinite dynamic range sensing and perform signal down-sampling.

Computational pixel imager with in-pixel histogram acquisition

A stereo imaging system includes an optical assembly and a computational pixel imager (CPI) having a plurality of pixels. Each pixel includes a light sensor and counters that convert a photocurrent from the light sensor to a digital signal. The optical assembly, which directs light from a light field to the CPI, includes an optical field combiner and first and second primary lens assemblies, which are configured to receive first and second portions of the light from the lightfield, respectively, and to direct the first and second portions of the light to the optical field combiner. The optical field combiner includes a modulator configured to modulate the first and second portions of the light and to direct modulated first and second portions of the light onto the CPI. The counters are configured to perform digital signal processing on the digital signal.

Systems and methods for digital imaging using computational pixel imagers with multiple in-pixel counters

A stereo imaging system includes an optical assembly and a computational pixel imager (CPI) having a plurality of pixels. Each pixel includes a light sensor and counters that convert a photocurrent from the light sensor to a digital signal. The optical assembly, which directs light from a light field to the CPI, includes an optical field combiner and first and second primary lens assemblies, which are configured to receive first and second portions of the light from the light field, respectively, and to direct the first and second portions of the light to the optical field combiner. The optical field combiner includes a modulator configured to modulate the first and second portions of the light and to direct modulated first and second portions of the light onto the CPI. The counters are configured to perform digital signal processing on the digital signal.

When imaging bright objects, a conventional detector array can saturate, making it difficult to produce an image with a dynamic range that equals the scene's dynamic range. Conversely, a digital focal plane array (DFPA) with one or more m-bit counters can produce an image whose dynamic range is greater than the native dynamic range. In one example, the DFPA acquires a first image over a relatively brief integration period at a relatively low gain setting. The DFPA then acquires a second image over longer integration period and/or a higher gain setting. During this second integration period, counters may roll over, possibly several times, to capture a residue modulus 2of the number of counts (as opposed to the actual number of counts). A processor in or coupled to the DFPA generates a high-dynamic range image based on the first image and the residues modulus 2.

Methods and apparatus for true high dynamic range imaging

A digital focal plane array includes an all-digital readout integrated circuit in combination with a detector array. The readout circuit includes unit cell electronics, orthogonal transfer structures, and data handling structures. The unit cell electronics include an analog to digital converter. Orthogonal transfer structures enable the orthogonal transfer of data among the unit cells. Data handling structures may be configured to operate the digital focal plane array as a data encryptor/decipherer. Data encrypted and deciphered by the digital focal plane array need not be image data.

Focal plane array processing method and apparatus

In time-delay-and-integrate (TDI) imaging, a charge-couple device (CCD) integrates and transfers charge across its columns. Unfortunately, the limited well depth of the CCD limits the dynamic range of the resulting image. Fortunately, TDI imaging can be implemented with a digital focal plane array (DFPA) that includes a detector, analog-to-digital converter (ADC), and counter in each pixel and transfer circuitry connected adjacent pixels. During each integration period in the TDI scan, each detector in the DFPA generates a photocurrent that the corresponding ADC turns into digital pulses, which the corresponding counter counts. Between integration periods, the DFPA transfers the counts from one column to the next, just like in a TDI CCD. The DFPA also non-destructively transfers some or all of the counts to a separate memory. A processor uses these counts to estimate photon flux and correct any rollovers caused by 'saturation' of the counters.

Methods and apparatus for true high dynamic range (THDR) time-delay-and-integrate (TDI) imaging

An imaging system uses a dynamically varying coded mask, such as a spatial light modulator (SLM), to time-encode multiple degrees of freedom of a light field in parallel and a detector and processor to decode the encoded information. The encoded information may be decoded at the pixel level (e.g., with independently modulated counters in each pixel), on a read-out integrated circuit coupled to the detector, or on a circuit external to the detector. For example, the SLM, detector, and processor may create modulation sequences representing a system of linear equations where the variables represent a degree of freedom of the light field that is being sensed. If the number of equations and variables form a fully determined or overdetermined system of linear equations, the system of linear equations' solution can be determined through a matrix inverse. Otherwise, a solution can be determined with compressed sensing reconstruction techniques with the constraint that the signal is sparse in the frequency domain.

Growing community of inventors

North Reading, MA, United States of America

Michael W Kelly