Massachusetts Institute of Technology

Northwestern University

Peking University

Boxin Shi

Ramesh Raskar

Achuta Kadambi

Vage Taamazyan

Alex Olwal

Aggelos K Katsaggelos

Tiejun Huang

Oliver Strider Cossairt

Ayush Bhandari

Zihao Wang

Hang Zhao

Munehiko Sato

Peiqi Duan

An imaging system includes an event camera configured to capture a first image of a scene. The system also includes a shutter camera collocated with the event camera, where the shutter camera is configured to capture a second image of the scene. The system also includes a processor operatively coupled to the event camera and the shutter camera. The processor is configured to apply guided event filtering (GEF) on the first image and the second image. The processor is also configured to generate a third image based on filtering of the first image and the second image.

System and method for high-resolution, high-speed, and noise-robust imaging

A 3D imaging system uses a depth sensor to produce a coarse depth map, and then uses the coarse depth map as a constraint in order to correct ambiguous surface normals computed from polarization cues. The imaging system outputs an enhanced depth map that has a greater depth resolution than the coarse depth map. The enhanced depth map is also much more accurate than could be obtained from the depth sensor alone. In many cases, the imaging system extracts the polarization cues from three polarized images. Thus, in many implementations, the system takes only three extra images&#x2014;in addition to data used to generate the coarse depth map&#x2014;in order to dramatically enhance the coarse depth map.

Methods and apparatus for enhancing depth maps with polarization cues

A time-of-flight camera images an object around a corner or through a diffuser. In the case of imaging around a corner, light from a hidden target object reflects off a diffuse surface and travels to the camera. Points on the diffuse surface function as a virtual sensors. In the case of imaging through a diffuser, light from the target object is transmitted through a diffusive media and travels to the camera. Points on a surface of the diffuse media that is visible to the camera function as virtual sensors. In both cases, a computer represents phase and intensity measurements taken by the camera as a system of linear equations and solves a linear inverse problem to (i) recover an image of the target object; or (ii) to compute a 3D position for each point in a set of points on an exterior surface of the target object.

Methods and apparatus for virtual sensor array

In illustrative implementations of this invention, light sources illuminate a surface with multi-spectral, multi-directional illumination that varies in direction, wavelength, coherence and collimation. One or more cameras capture images of the surface while the surface is illuminated under different lighting conditions. One or more computers take, as input, data indicative of or derived from the images, and determine a classification of the surface. Based on the computed classification, the computers output signals to control an I/O device, such that content displayed by the I/O device depends, at least in part, on the computed classification. In illustrative implementations, this invention accurately classifies a wide range of surfaces, including transparent surfaces, specular surfaces, and surfaces with few features.

Methods and apparatus for surface classification

Growing community of inventors

Singapore, Singapore

Boxin Shi