Harvard College

University of California

Centeye Incorporated

Todd Zickler

Federico Capasso

David J Kriegman

Peter Neil Belhumeur

Yao-Wei Huang

Zhujun Shi

Qi Guo

Satya P Mallick

Emma Alexander

Geoffrey Louis Barrows

Sanjeev Jagannatha Koppal

Ioannis Gkioulekas

Disclosed is a depth sensor for determining depth. The depth sensor can include a photosensor, a metalens configured to manipulate light to simultaneously produce at least two images having different focal distances on a surface of the photosensor, and processing circuitry configured to receive, from the photosensor, a measurement of the at least two images having different focal distances. The depth sensor can determine, according to the measurement, a depth associated with at least one feature in the at least two images.

Compact metalens depth sensors

Briefly, embodiments of an optical micro-sensor are described.

Optical micro-sensor

The present invention presents a framework for separating specular and diffuse reflection components in images and videos. Each pixel of the an M-channel input image illuminated by N light sources is linearly transformed into a new color space having (M&#x2212;N) channels. For an RGB image with one light source, the new color space has two color channels (U,V) that are free of specularities and a third channel (S) that contains both specular and diffuse components. When used with multiple light sources, the transformation may be used to produce a specular invariant image. A diffuse RGB image can be obtained by applying a non-linear partial differential equation to an RGB image to iteratively erode the specular component at each pixel. An optional third dimension of time may be added for processing video images. After the specular and diffuse components are separated, dichromatic editing may be used to independently process the diffuse and the specular components to add or suppress visual effects. The (U,V) channels of images can be used as input to 3-D shape estimation algorithms including shape-from-shading, photometric stereo, binocular and multinocular stereopsis, and structure-from-motion.

Method for editing multi-channel images

Methods for identifying, separating and editing reflection components in multi-channel images and videos

Growing community of inventors

Cambridge, MA, United States of America

Todd Zickler