Dolby Laboratories Licensing Corporation

King Abdullah University of Science and Technology

Mtt Innovation Incorporated

Massachusetts Institute of Technology

Nvidia Corporation

Princeton University

University of British Columbia

Dolby Laboratories Licensing Corproation

Wolfgang Heidrich

Gregory John Ward

Helge Seetzen

Lorne Arthur Whitehead

James Gregson

Gerwin Damberg

Allan G Rempel

Gordon Wetzstein

Felix Heide

Xiong Dun

Ramesh Raskar

Qiang Fu

Mushfiqur Rouf

Andres A Aguirre-Pablo

Abdulrahman B Aljedaani

Jinhui Xiong

Ramzi Idoughi

Sigurdur Tryggvi Thoroddsen

Congli Wang

Matthias Hullin

Douglas Robert Lanman

David Patrick Luebke

Matthew Waggener Hirsch

Erqiang Li

Ivo Bodo Ihrke

Matthew Trentacoste

Seung-Hwan Baek

Ilya Chugunov

Allan Rempel

A new projector design combines one spatial light modulator that affects only the phase of the illumination, and one spatial light modulator that only affects its amplitude (intensity). The phase-only modulator curves the wavefront of light and acts as a pre-modulator for a conventional amplitude modulator. This approach works with both white light and laser illumination, generating a coarse image representation efficiently, thus enabling, within a single image frame, significantly elevated highlights as well as darker black levels while reducing the overall light source power requirements.

Efficient, dynamic, high contrast lensing with applications to imaging, illumination and projection

A wavefront sensor includes a mask and a sensor utilized to capture a diffraction pattern generated by light incident to the mask. A reference image is captured in response to a plane wavefront incident on the mask, and another measurement image is captured in response to a distorted wavefront incident on the mask. The distorted wavefront is reconstructed based on differences between the reference image and the measurement image.

Wavefront sensor and method of reconstructing distorted wavefronts

The microlens amplitude masks for flying pixel removal in time-of-flight imaging includes systems, devices, methods, and instructions for image depth determination, including receiving an image, adding noise to the image, determining a set of correlation images, each correlation image having a varying phase offset, for each pixel of the image, generating a masked pixel by applying a mask array, and for each masked pixel, determining the depth of the masked pixel to generate a depth map for the image on a per pixel basis.

Microlens amplitude masks for flying pixel removal in time-of-flight imaging

A method for tracking moving particles in a fluid. The method includes illuminating the moving particles with an illumination sequence of patterns generated by a light projector; measuring with a single camera light intensities reflected by the moving particles; calculating, based on the measured light intensity, digital coordinates (x', y&#x2032;, z&#x2032;) of the moving particles; determining a mapping function f that maps the digital coordinates (x&#x2032;, y&#x2032;, z&#x2032;) of the moving particles to physical coordinates (x, y, z) of the moving particles; and calculating the physical coordinates (x, y, z) of the moving particles based on the mapping function f. The illumination sequence of patterns is generated with a single wavelength, and light emitted by the projector is perpendicular to light received by the single camera.

Single-camera particle tracking system and method

Apparatus and methods are provided that employ one or more of a variety of techniques for reducing the time required to display high resolution images on a high dynamic range display having a light source layer and a display layer. In one technique, the image resolution is reduced, an effective luminance pattern is determined for the reduced resolution image, and the resolution of the effective luminance pattern is then increased to the resolution of the display layer. In another technique, the light source layer's point spread function is decomposed into a plurality of components, and an effective luminance pattern is determined for each component. The effective luminance patterns are then combined to produce a total effective luminance pattern. Additional image display time reduction techniques are provided.

Rapid estimation of effective illuminance patterns for projected light fields

Systems and methods for imaging object velocity are provided. In an embodiment, at least one Time-of-Flight camera is used to capture a signal representative of an object in motion over an exposure time. Illumination and modulation frequency of the captured motion are coded within the exposure time. A change of illumination frequency is mapped to measured pixel intensities of the captured motion within the exposure time, and information about a Doppler shift in the illumination frequency is extracted to obtain a measurement of instantaneous per pixel velocity of the object in motion. The radial velocity information of the object in motion can be simultaneously captured for each pixel captured within the exposure time. In one or more aspects, the illumination frequency can be coded orthogonal to the modulation frequency of the captured motion. The change of illumination frequency can correspond to radial object velocity.

Doppler time-of-flight imaging

Imaging of complex, non-stationary three dimensional (3D) flow velocities is achieved by encoding depth into color. A flow volumeis illuminated with a continuumof light planeswhereby each depth corresponds to a respective light planehaving a specific wavelength of light. A diffractive componentin the cameraoptics, which records the trajectories of illuminated particleswithin the flow volume, ensures that all light planesare in focus simultaneously. The setup permits a user to track 3D trajectories of particleswithin the flow volumeby combining two dimensional (2D) spatial and one dimensional (1D) color information. For reconstruction, an image formation model for recovering stationary 3D particle positions is provided. 3D velocity estimation is achieved with a variant of a 3D optical flow approach that accounts for both physical constraints as well as the color (rainbow) image formation model.

Rainbow particle imaging velocimetry for dense 3D fluid velocity imaging

Apparatus and methods are provided that employ one or more of a variety of techniques for reducing the time required to display high resolution images on a high dynamic range display having a light source layer and a display layer. In one technique, the image resolution is reduced, an effective luminance pattern is determined for the reduced resolution image, and the resolution of the effective luminance pattern is then increased to the resolution of the&#x2014;display layer. In another technique, the light source layer's point spread function is decomposed into a plurality of components, and an effective luminance pattern is determined for each component. The effective luminance patterns are then combined to produce a total effective luminance pattern. Additional image display time reduction techniques are provided.

A camera has two distinct image sensor arrays. The image sensor arrays are at least one of different types and different resolutions. The image sensor arrays have different dynamic ranges such that one of the image sensor arrays is a high dynamic range image sensor array configured to capture a wider range of light intensity than the other of the image sensor arrays. The camera has an imaging mechanism configured to combine information collected by each of the image sensor arrays to produce a high dynamic range image. The image sensor arrays include one low resolution image sensor array having a high dynamic range, and one high resolution image sensor array having a normal dynamic range smaller than the high dynamic range wherein luminance values within the normal dynamic range represent a subset of luminance values within the high dynamic range.

Electronic camera having multiple sensors for capturing high dynamic range images and related methods

Growing community of inventors

Vancouver, Canada

Wolfgang Heidrich