Pixim, Incorporated

Zhonghan John Deng

David Xiao Dong Yang

Odutola Oluseye Ewedemi

Ricardo Jansson Motta

Xiao Dong Yang

Yi-Hen Wei

Xi Peng

An image sensor includes a sensor or a pixel array, a data memory, and a logic circuit, all fabricated on the same integrated chip. The sensor or pixel array outputs digital signals as pixel data representing an image of a scene. The data memory is coupled to the sensor or pixel array for storing the pixel data. The logic circuit is coupled to the data memory and provides a memory interface for exporting the pixel data. The memory interface can be one of a SRAM, a DRAM or a packet protocol synchronous DRAM interface. Including a memory interface in the image sensor allows the image sensor to be coupled directly to the memory interface port of an external image processing unit. The image processing unit can access the image sensor using conventional memory access protocols, thus improving the efficiency and reducing the operational complexity of the image processing unit.

CMOS sensor array with a memory interface

An architecture for a digital pixel sensor is disclosed in which the dynamic range of the sensor is increased by taking samples of a subject to be recorded, where each sample is taken over an interval of a different duration than the other samples. In the preferred embodiment of the invention, an array of pixel elements is fabricated in an integrated circuit. Each of the pixel elements outputs a digital signal and comprises a photodetector and an analog to digital converter. The photodetector is integrated with the analog to digital converter. An array of threshold memory cells, each corresponding to one of the pixel elements, is also provided. An array of time memory cells, each corresponding to one of the pixel elements, establishes a different sampling time for each of the pixel elements for each of multiple samples. An array of memory elements, each coupled to one of the pixel elements, is also provided. The memory elements are also fabricated in the integrated circuit. The memory elements only receive a value from a corresponding one of the pixel elements when the content in a corresponding one of the threshold memory cells permits. In this way, multiple samples may be collected for a subject to be recorded to thereby extend the dynamic range of a photodetector. Integration of the photodetector and the memory that implements this mechanism into the same integrated circuit avoids the latency that would be experienced if an external memory was used.

Multiple sampling via a time-indexed method to achieve wide dynamic ranges

An improved technique for updating a memory in digital pixel sensors in which a memory update may be directed to only some of the locations or cells in the memory is disclosed. According to one embodiment, a multiplex scheme is employed, in which a threshold memory identifies the locations within a row of memory that are to be updated. Data are first read out of a row of memory to be updated. The data are copied to a first buffer or other short term storage area within the digital pixel sensor. New data from the sensor portion of the digital pixel sensor to be written to the memory are stored in a second buffer. The contents of the threshold memory are then applied to a select input of a multiplexer, where the contents of the first and second buffers comprise first and second data inputs to the multiplexer. Thus, the output of the multiplexer comprises an updated row of memory in which only those locations that are to be updated have been changed. The output of the multiplexer is preferably written directly back to the memory and a next row of memory may then be updated.

Memory updating for digital pixel sensors

An image sensor includes a sensor array, a data memory for storing pixel data and a pixel normalization circuit. The sensor array has a two-dimensional array of pixel elements and outputs digital signals as pixel data representing an image of a scene. The pixel data outputted by the sensor array are arranged in a sensor-bit arrangement and the pixel normalization circuit rearranges the pixel data into a pixel-bit order. In another embodiment, an image sensor includes a sensor array, a data memory, and a pixel normalization circuit, all fabricated on a single integrated circuit. The pixel normalization circuit includes one or more of a pixel rearrangement circuit, a Gray code to binary conversion circuit, a reset subtract circuit, and a multiple sampling normalization circuit. Finally, a Gray code to binary conversion circuit is provided for high speed conversion.

Circuit and method for pixel rearrangement in a digital pixel sensor readout

An image sensor, including a substrate having formed thereon by a CMOS process a digital sensor array having a plurality of digital pixel sensors which output analog signals corresponding to a desired image. The digital sensor array further includes supporting circuitry for converting the analog signals produced by the digital pixel sensors to digital signals corresponding to the desired image. Filter circuitry, for converting the digital signals to digital values representative of the light intensity impinging upon the plurality of digital pixel sensors, is also formed on the substrate using CMOS fabrication processes. Memory devices, including a data memory, a threshold memory, and a time index memory are formed on the substrate using CMOS fabrication techniques. A clock circuit is also formed on the substrate using CMOS fabrication processes. Programmable logic structures are formed on the substrate using CMOS fabrication processes. The programmable logic structure can be configured into a variety of circuitry or routing so as to facilitate customization or specialization of the image sensor.

Digital image sensor with on -chip programmable logic

A method of optimizing the exposure times of regions of pixels of an image sensor array during exposure is accomplished by utilizing time interval sampling of an image sensor array comprising of pixels configured to generate digital image signals. Luminance values are extracted from each digital image signal and analyzed to determine if a pixel has reached the optimal exposure. If a pixel has reached the optimal exposure, subsequent digital image signals from this pixel will not be recorded. This preserves the recording of the optimal digital image signal generated by the pixel at the time when the pixel reached its optimal exposure. This process of selectively terminating the recording of digital image signals based on optimal exposures of the pixels can be performed on individual pixels or can be performed on a region of pixels.

Method and apparatus for optimizing exposure time in image acquisitions

The invention relates to a CMOS image sensor that an be embedded in portable imaging systems. This high spatial resolution and low bit resolution CMOS area image sensor not only enables portable imaging systems such as cellular fax phone, portable copy machines, barcode reader, but also it can be fabricated in standard digital CMOS processes, particularly at 0.35 micron and below. This invention also discloses several portable imaging systems using such a CMOS image sensor. This invention further discloses a CMOS image sensor that has variable spatial resolution and bit resolution. Starting as a high spatial resolution low-bit resolution image sensor, the high bit-resolution is achieved by combining information from a group of nearest-neighbor pixels into a single super-pixel via spatial oversampling. This variable CMOS image sensor can be used in a multiple function imaging device for both document and video imaging, or photography.

Process-scalable high spatial resolution and low bit resolution CMOS area image sensor

The invention relates to a CMOS image sensor that can be embedded in portable imaging systems. This high spatial resolution and low bit resolution CMOS area image sensor not only enables portable imaging systems such as cellular fax phone, portable copy machines, barcode reader, but also it can be fabricated in standard digital CMOS processes, particularly at 0.35 micron and below. This invention also discloses several portable imaging systems using such a CMOS image sensor. This invention further discloses a CMOS image sensor that has variable spatial resolution and bit resolution. Starting as a high spatial resolution low-bit resolution image sensor, the high bit-resolution is achieved by combining information from a group of nearest-neighbor pixels into a single super-pixel via spatial oversampling. This variable CMOS image sensor can be used in a multiple function imaging device for both document and video imaging, or photography.

Growing community of inventors

Mountain View, CA, United States of America

Zhonghan John Deng