Microsoft Technology Licensing, LLC

Beijing Xiaomi Mobile Software Co., Ltd.

Jiaping Wang

Baining Guo

Xin Tong

Stephen S Lin

Heung-Yeung Shum

John Michael Snyder

Zhouchen Lin

Peiran Ren

Minmin Gong

Moshe Benezra

Kun Zhou

Yongfeng Xia

Shuang Zhao

Liang Cheng

Yanyun Chen

Yue Dong

The present disclosure relates to a holographic projection device, a holographic projection method, and a holographic projection apparatus. The holographic projection device includes a first stereoscopic imaging device including a plurality of transparent pixel blocks; and a light emitting device including a plurality of light emitting units, wherein the plurality of transparent pixel blocks have a one-to-one correspondence with the plurality of light emitting units, and wherein for a light emitting unit A of the plurality of light emitting units, the light emitting unit A is configured to illuminate a transparent pixel block A, and the transparent pixel block A is a transparent pixel block corresponding to the light emitting unit A in the plurality of transparent pixel blocks.

Holographic projection device, method, apparatus, and computer readable storage medium

Some implementations disclosed herein provide techniques and arrangements to render global light transport in real-time or near real-time. For example, in a pre-computation stage, a first computing device may render points of surfaces (e.g., using multiple light bounces and the like). Attributes for each of the points may be determined. A plurality of machine learning algorithms may be trained using particular attributes from the attributes. For example, a first machine learning algorithm may be trained using a first portion of the attributes and a second machine learning algorithm may be trained using a second portion of the attributes. The trained machine learning algorithms may be used by a second computing device to render components (e.g., diffuse and specular components) of indirect shading in real-time.

Rendering global light transport in real-time using machine learning

Described is a search technology in which spatially varying anisotropic reflectance is modeled using image data captured from a single view. Reflectance at each point is represented using a microfacet-based Bidirectional Reflectance Distribution Function (BRDF). Modeling processes the image data, which provides a partial normal distribution function (NDF) for each surface point. The NDF at each selected point is completed by texture synthesis using similar, overlapping partial NDFs from other points. Also described is a scanning device that illuminates a sample surface from a two-dimensional set of light directions using a linear array of LEDs moved over a flat sample.

Modeling anisotropic surface reflectance with microfacet synthesis

A system for reflectance acquisition of a target includes a light source, an image capture device, and a reflectance reference chart. The reflectance reference chart is fixed relative to the target. The light source provides a uniform band of light across at least a dimension of the target. The image capture device is configured and positioned to encompass at least a portion of the target and at least a portion of the reflectance reference chart within a field-of-view of the image capture device. The image capture device captures a sequence of images of the target and the reflectance reference chart during a scan thereof. Reflectance responses are calculated for the pixels in the sequence of images. Reference reflectance response distribution functions are matched to the calculated reflectance responses, and an image of the target is reconstructed based at least in part on the matched reference reflectance response distribution functions.

Obtaining spatially varying bidirectional reflectance distribution function

An exemplary method includes providing image data for an illuminated physical sample of a heterogeneous translucent material, determining one or more material properties of the material based in part on a diffusion equation where one of the material properties is a diffusion coefficient for diffusion of radiation in the material and where the determining includes a regularization term for the diffusion coefficient, mapping the one or more material properties to a virtual object volume, assigning virtual illumination conditions to the virtual object volume, and rendering the virtual object volume using the virtual illumination conditions as a boundary condition for a system of diffusion equations of the virtual object volume. Other methods, devices and systems are also disclosed.

Modeling and rendering of heterogeneous translucent materals using the diffusion equation

A mechanism is disclosed for capturing reflected rays from a surface. A first and second lens aligned along a same optical center axis are configured so that a beam of light collimated parallel to the lens center axis directed to a first side, is converged toward the lens center axis on a second side. A first light beam source between the first and second lenses directs a light beam toward the first lens parallel to the optical center axis. Second light beam source(s) on the second side of the first lens, direct a light beam toward a focal plane of the first lens at a desired angle. An image capturing component, at the second side of the second lens, has an image capture surface directed toward the second lens to capture images of the light reflected from a sample capture surface at the focal plane of the first lens.

Capturing reflected light from a sampling surface

A 'Scene Re-Lighter' provides various techniques for using an automatically reconstructed light transport matrix derived from a sparse sampling of images to provide various combinations of complex light transport effects in images, including caustics, complex occlusions, inter-reflections, subsurface scattering, etc. More specifically, the Scene Re-Lighter reconstructs the light transport matrix from a relatively small number of acquired images using a 'Kernel Nystr&#xf6;m' based technique adapted for low rank matrices constructed from sparsely sampled images. A &#x201c;light transport kernel&#x201d; is incorporated into the Nystr&#xf6;m method to exploit nonlinear coherence in the light transport matrix. Further, an adaptive process is used to efficiently capture the sparsely sampled images from a scene. The Scene Re-Lighter is capable of achieving good reconstruction of the light transport matrix with only few hundred images to produce high quality relighting results. Further, the Scene Re-Lighter is also effective for modeling scenes with complex lighting effects and occlusions.

Light transport reconstruction from sparsely captured images

Modeling and rendering of heterogeneous translucent materials using the diffusion equation

A method for modeling a time-variant appearance of a material is described. A sample analysis of a material sample is performed, wherein the sample analysis orders surface points of the material sample with respect to weathering from data captured at a single instant in time. An appearance synthesis using the sample analysis is performed, wherein the appearance synthesis generates a time-variant sequence of frames for weathering an object.

Appearance manifolds for modeling time-variant appearance of materials

A method, device and system is provided for providing global illumination of a scene. For example, global illumination may be provided in a rendered 3-dimensional image that may contain objects and/or light sources. Radiance functions or visibility functions may further be represented by scaling of spherical harmonics functions in the spherical harmonics domain. For example, scaling of spherical harmonics coefficients corresponding to a spherical function may be performed based on a spherical harmonics scaling transformation matrix based on an angular scaling function.

Spherical harmonics scaling

A method and system for implementing capturing and rendering geometric details for mesostructure surfaces is described herein. A mesostructure distance function is defined as a function of a given reference point and a given viewing direction. A distance from a reference point to a mesostructure surface point along a viewing direction is measured using the mesostructure distance function. This distance is used to determine the visibility of mesostructure surface for rendering silhouettes. The lighting visibility of the mesostructure surface point may also be determined and used for determining whether the mesostructure surface point is in shadow. This determination may then be used for rendering shadow silhouettes.

Capturing and rendering geometric details

Representing quasi-homogenous materials is described. In one aspect, quasi-homogenous materials are modeled to generate a material model of a physical sample. The material model identifies how light is scattered by the quasi-homogenous materials. The material model, independent of an object model of the physical sample, provides information that is useful to texture surfaces of arbitrary types and sizes of mesh models (e.g., representing the physical sample or other objects) with the quasi-homogenous materials.

Growing community of inventors

Beijing, China

Jiaping Wang