Himax Technologies, Inc.

National Taiwan University

Himax Imaging, Inc.

Yi-Nung Liu

Cheng-Hung Chi

Chin-Jung Tsai

Ming-Shu Hsiao

Shao-Yi Chien

Kuan-Ming Chen

Biing-Seng Wu

Ling-Hsiu Huang

Han-Yi Kuo

Yi-Chun Lin

Yu-Hsuan Chu

Nai-Ting Chang

Homer H Chen

Hung-Shan Chen

Po-Chang Chen

Ming-Syuan Chen

Li-Chiu Tsai

Huan-Pin Tseng

Po-Hsun Su

Wei-Chi Tu

Wei-Kai Chan

Chih-Tsung Shen

Po-Yen Su

A system for handling a thermal compensation comprises: an image capturing device comprising a capturing circuit, for capturing a first image, and a first sensing circuit, for detecting a first temperature; a projecting device comprising a second sensing circuit, for detecting a second temperature; a storage device, for storing a plurality of first parameters associated with the image capturing device, a plurality of second parameters associated with the projecting device and a reference image associated with the projecting device; and a processing device comprising a processing circuit, for compensating the first image according to the first temperature and the plurality of first parameters, to generate a first compensated image, compensating the reference image according to the second temperature and the plurality of second parameters, to generate a second compensated image, and generating a second image according to the first compensated image and the second compensated image.

System and method for handling a thermal compensation

A liquid crystal element includes a substrate, a diffractive optical element layer, and a liquid crystal material. The diffractive optical element layer has an uneven surface. The liquid crystal material is between the substrate and the uneven surface of the diffractive optical element layer. The liquid crystal material is disposed contiguously with the uneven surface of the diffractive optical element layer.

Optical surface mapping system

A hybrid depth estimation system includes a switchable projector that controllably projects either dot light or surface light onto an object; a sensor that receives reflected dot light or reflected surface light from the object to capture a first image or a second image respectively; a dot time-of-flight (ToF) depth generator that generates a dot depth map and an associated dot confidence map according to the first image; a surface ToF depth generator that generates a surface depth map according to the second image; and a denoise processor that processes the surface depth map according to a plurality of points on the dot depth map with high confidence, thereby generating a denoised depth map.

Hybrid depth estimation system

A structured light projector including a light source, an irradiation range controlling device, and a diffractive optical element is provided. The irradiation range controlling device is disposed on a transmission path of a light beam from the light source. The diffractive optical element is disposed on a transmission path of the light beam from the irradiation range controlling device. The irradiation range controlling device is adapted to control an irradiation range of the light beam transmitted to the diffractive optical element so as to change a size of a region of the diffractive optical element illuminated by the light beam from the irradiation range controlling device. A three-dimensional image sensing module using the same is also provided.

Structured light projector and three-dimensional image sensing module

An illuminator including a light source and an optical device is provided. The light source is configured to emit light. The optical device is configured to provide uniform illumination with at least one indicating mark after receiving light. The optical device includes a diffusing part and a directing part. The diffusing part is configured to provide uniform illumination. The directing part is configured to provide at least one indicating mark.

Illuminator

A depth sensing apparatus and an operation method thereof are provided. The depth sensing apparatus includes a projector, multiple cameras, and an image processing circuit. The projector includes a diffraction optical element (DoE) and a light source module. Rays of the light source module selectively pass through at least one of multiple projection style regions of the DoE so as to generate a projection pattern, and the projection pattern is projected to a field. The cameras respectively shoot the projection pattern projected to the field to obtain multiple images. The image processing circuit processes the images to obtain multiple depth maps. The image processing circuit at least merges the depth maps to generate a final depth map of the field.

Depth sensing apparatus and operation method thereof

A depth decoding system and a method for rectifying a ground-truth image are introduced. The depth decoder system includes a projector, a camera, a processor and a decoder. The projector is configured to project a structural light pattern to a first reference plane and a second reference plane. The camera is configured to capture a first ground-truth image from the first reference plane and capture a second ground-truth image from the second reference plane. The processor is configured to perform a rectification operation to the first ground-truth image and the second ground-truth image to generate a rectified ground-truth image. The decoder is configured to generate a depth result according to the rectified ground-truth image.

Depth decoding system and method for ground truth image rectification

A method for performing auto-exposure (AE) control in a depth sensing system includes: capturing a first reference image and a second reference image of a scene based on different illumination conditions; calculating a plurality of first block means with respect to first blocks of the first reference frame and calculating a plurality of second block means with respect to second blocks of the second reference frame; calculating a plurality of block mean differences according to the first block means and the second block means; determining a plurality of first region of interest (ROI) blocks from the first blocks and a plurality of a second ROI blocks from the second blocks; and performing an AE control over the depth sensing system according to blocks means of the first ROI blocks and blocks means of the second ROI blocks.

Method and apparatus for auto-exposure control in a depth sensing system

An optical projection system includes an image sensor, a light emitting circuit and a processor. The image sensor is configured to capture an image of a target object. The processor is electrically coupled to the image sensor and the light emitting circuit. The processor is configured to determine a size of the target object, and control the light emitting circuit to emit an optical pattern and to fan out the optical pattern according to the size of the target object, in order to cover the target object.

Optical projection system and optical projection method

A structured-light projector includes a diffractive optical element (DOE) that receives a collimated light and generates a plurality of light tiles. The DOE includes a plurality of optical components disposed on a substrate, wherein the optical components of the DOE are randomly arranged on the substrate.

Structured-light projector

A depth-sensing device and its method are provided. The depth-sensing device includes a projection device, an image capture device, and an image processing device. The projection device projects a first projection pattern to a field at a first time and projects a second projection pattern to the same field at a second time. The density of the first projection pattern is lower than the density of the second projection pattern. The image capture device captures the first projection pattern projected to the field at the first time to obtain a first image and captures the second projection pattern projected to the field at the second time to obtain a second image. The image processing device processes the first and second images to obtain two depth maps and at least merges the depth maps to generate a final depth map of the field.

Depth-sensing device and depth-sensing method

A method for projection includes: emitting an input beam to a diffractive optical element (DOE); and diffracting the input beam via the DOE with a specific fan-out angle &#x3b8; and a number of fan-out points N on a surface, wherein the specific fan-out angle &#x3b8; and the number of fan-out points N fit the following equation: where &#x3bb; is a wavelength of the input beam, &#x394; is a pixel size of the DOE, and K is an integer not smaller than N.

Projection method and associated optical system

A bilateral filtering method includes decomposing an image patch by pixel intensity to form a stack of patches; computing spatial filtering response of each intensity; multiplying the spatial filtering response of each intensity by corresponding intensity, thereby resulting in multiplied spatial filtering response of each intensity; and summing up the multiplied spatial filtering responses of different intensities weighted with corresponding range weights.

Bilateral filter and a method thereof

A compensation method of spectral mismatch for a color filter array (CFA) comprising of white, red, green, and blue (WRGB) color filters includes introducing an offset representing spectral mismatch to modify a linear model that relates a W component of a pixel to R, G, and B components of the pixel. In one embodiment, an estimated offset is generated according to readout component images, and a compensated component image is generated according to the estimated offset and a corresponding readout component image.

Compensation method of spectral mismatch

A camera array system includes an image sensor device, a hybrid color filter array disposed above the image sensor device, and a lens array disposed above the hybrid color filter array. The hybrid color filter array includes plural kinds of monochromatic color filters and at least one mosaic filter; and the lens array includes a number of optic lenses. The at least one mosaic filter is utilized to perform stereo matching in order to estimate depth information.

Growing community of inventors

Tainan, Taiwan

Yi-Nung Liu