Microsoft Technology Licensing, LLC

Moshe Benezra

Baining Guo

John Michael Snyder

Xin Tong

Jiaping Wang

Chi Cui

Bennett S Wilburn

Samples of a scene are acquired in synchronization with finely interleaved varying conditions such as lighting, aperture, focal length, and so forth. A time-varying sample at each pixel for each condition is reconstructed. Time multiplexed interleaving allows for real-time, live applications, while handling motion blur naturally. Effects such as real-time video relighting of a scene is possible. Time interleaved exposures also allow segmentation of a scene, and allows for constrained special effects such as triangulation matting using a multi-color interleaved chroma key.

Time interleaved exposures and multiplexed illumination

Multi-spectral imaging technique embodiments are presented which involve an active imaging approach that uses wide band illumination of known spectral distributions to obtain multi-spectral reflectance information in the presence of unknown ambient illumination. In general, a reflectance spectral distribution of a captured scene is computed by selecting a number of different illumination spectra and capturing multiple images of the scene. Each of these images is captured when the scene is illuminated by a different one of the selected illumination spectra in addition to the ambient light. The reflectance spectral distribution of the scene is computed for each pixel location based on the relative response between pairs of the radiometric responses of the corresponding pixels in the captured images, given a set of parameters including the added illumination spectra used to capture each of the images and the response function and spectral sensitivity of the camera used to capture the images.

Multi-spectral imaging

A mechanism is disclosed for capturing reflected rays from a surface. A first and second lens aligned along a same optical center axis are configured so that a beam of light collimated parallel to the lens center axis directed to a first side, is converged toward the lens center axis on a second side. A first light beam source between the first and second lenses directs a light beam toward the first lens parallel to the optical center axis. Second light beam source(s) on the second side of the first lens, direct a light beam toward a focal plane of the first lens at a desired angle. An image capturing component, at the second side of the second lens, has an image capture surface directed toward the second lens to capture images of the light reflected from a sample capture surface at the focal plane of the first lens.

Growing community of inventors

Beijing, China

Moshe Benezra