Google Inc.

Carnegie Mellon University

University of Toronto

Qualcomm Incorporated

Supreeth Achar

Srinivasa Narasimhan

Daniel Goldman

Kiriakos Neoklis Kutulakos

Matthew O'Toole

Jason Lawrence

Zhihao Xia

Aleksandar Jovicic

William L Whittaker

Joseph Bartels

Harris Samuel Nover

Kiriakos Kutulakos

An imaging system includes a processor, a memory, a visible light camera configured to record a first image of a scene, and an infrared camera configured to record a second image of the scene. The processor configured to execute instructions stored in the memory to input the first image and the second image into a neural network. The neural network relights the first image, based on characteristics of the second image, to correspond to an image of the scene under canonical illumination conditions.

Infrared light-guided portrait relighting

Techniques of estimating surface normals and reflectance from poorly-lit images includes using, in addition to an RGB image of a subject of a set of subjects, an image illuminated with near-infrared (NIR) radiation to determine albedo and surface normal maps for performing an image relighting, the image being captured with the NIR radiation from essentially the same perspective from which the RGB image was captured. In some implementations, a prediction engine takes as input a single RGB image and a single NIR image and estimates surface normals and reflectance from the subject.

Dark flash normal camera

A method including capturing a first image of a real-world scene by a first camera sensitive to a first spectrum of light, the first camera having a first light source, capturing a second image of the real-world scene by a second camera sensitive to a second spectrum of light, the second camera having a second light source, identifying at least one feature in the first image, identifying, using a machine learning (ML) model, at least one feature in the second image that matches the at least one feature identified in the first image, mapping pixels in the first image and the second image to rays in a three-dimensional (3D) space based on the matched at least one feature, and calibrating the first camera and the second camera based on the mapping.

Cross spectral feature mapping for camera calibration

An energy optimized imaging system that includes a light source that has the ability to illuminate specific pixels in a scene, and a sensor that has the ability to capture light with specific pixels of its sensor matrix, temporally synchronized such that the sensor captures light only when the light source is illuminating pixels in the scene.

Energy optimized imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor

Energy-efficient epipolar imaging is applied to the ToF domain to significantly expand the versatility of ToF sensors. The described system exhibits 15+ m range outdoors in bright sunlight; robustness to global transport effects such as specular and diffuse inter-reflections; interference-free 3D imaging in the presence of many ToF sensors, even when they are all operating at the same optical wavelength and modulation frequency; and blur- and distortion-free 3D video in the presence of severe camera shake. The described embodiments are broadly applicable in consumer and robotics domains.

Method for epipolar time of flight imaging

According to an aspect, a real-time active stereo system includes a capture system configured to capture stereo image data, where the image data includes a plurality of pairs of a reference image and a secondary image, and each pair of the plurality of pairs relates a different temporal window. The real-time active stereo system includes a depth sensing computing system including at least one processor and a non-transitory computer-readable medium having executable instructions that when executed by the at least one processor are configured to execute a local stereo reconstruction algorithm configured to compute spacetime descriptors from the plurality of pairs of the stereo image data and generate depth maps based on the spacetime descriptors.

Real-time spacetime stereo using spacetime descriptors

Imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor

Methods, systems, and devices are described for commissioning light fixtures. One method may include receiving, at a mobile device, an encoded light signal from a light fixture in a plurality of light fixtures. The encoded light signal may be decoded to obtain an identifier associated with the light fixture, and a correspondence between the identifier and a plurality of locations of the plurality of light fixtures may be determined.

Growing community of inventors

Seattle, WA, United States of America

Supreeth Achar