Disney Enterprises, Inc.

Facebook Technologies, LLC

Microsoft Technology Licensing, LLC

Pixar

Eth Zurich (eidgenoessische Technische Hochschule Zurich)

Disney Enterprise, Inc.

Derek Nowrouzezahrai

Wojciech Jarosz

Douglas Robert Lanman

Yusufu Njoni Bamaxam Sulai

Kevin James MacKenzie

Marina Zannoli

James Hillis

Olivier Mercier

Kenneth John Mitchell

Peter-Pike Sloan

Matthias Zwicker

Robert Thomas

Scott Frazier Watson

John Michael Snyder

Robert Walker Sumner

Ilya Baran

Kenny Mitchell

Marios Papas

Manuel Lang

Michael Kaschalk

Toshiya Hachisuka

Iliyan Georgiev

Andy Selle

Jesse Dylan Lacewell

Stefan C Geiger

Thomas Williams

Jared Johnson

Thomas Houit

Kartic Subr

Mahdi MohammadBagher

Mahdi Mohammadbagher

A multifocal test system is described herein. The system includes a plurality of displays located at different focal distances. Each display includes a plurality of pixels with pixel intensity values. The system includes an eye tracking system that determines eye tracking information about a position of an eye relative to the displays. A controller is configured to determine pixel intensity values based on decomposition of a scene across the plurality of displays, and the position of the eye.

Multifocal test system

Systems and methods for displaying an image across a plurality of displays are described herein. Pixel intensity values in the multifocal display are determined using correlation values and numerical iterations. An eye tracking system measures eye tracking information about a position of a user's eye, and the pixel intensity values are modified based on the eye tracking information. An image is displayed on the plurality of displays based on the determined pixel intensity values. The plurality of displays may be within an HMD, and address vergence accommodation conflict by simulating retinal defocus blur.

Real-time multifocal displays with gaze-contingent rendering and optimization

A plurality of measured sample data points associated with reflectance on a surface of a material is obtained. A non-parametric densely tabulated one-dimensional representation for a plurality of factors in a microfacet model is generated, using the obtained sample data points.

Non-parametric microfacet factor models for isotropic bidirectional reflectance distribution functions

Systems, methods and articles of manufacture for sampling visual characteristics of a three-dimensional scene. Embodiments include collecting a plurality of samples within the three-dimensional scene. Upon determining that a combined stratified importance sampling algorithm will result in reduced error for a rendered image of the three-dimensional scene, embodiments collect the plurality of samples using the combined stratified importance sampling algorithm, and otherwise the plurality of samples are collected using a stratified sampling algorithm. The combined stratified importance sampling algorithm integrates an antithetic sampling algorithm. One or more lighting effects for the three-dimensional scene are simulated based on the plurality of samples and data describing one or more light sources for the three-dimensional scene. Embodiments further include rendering the image based on the simulated one or more lighting effects and data describing characteristics of the three-dimensional scene.

Combining sampling arrangements and distributions for stochastic integration in rendering

Methods and systems of joint path importance sampling are provided to construct light paths in participating media. The product of anisotropic phase functions and geometric terms across a sequence of path vertices are considered. A connection subpath is determined to join a light source subpath with a light receiver subpath with multiple intermediate vertices while considering the product of phase functions and geometry terms. A joint probability density function ('PDF') may be factorized unidirectional or bidirectional. The joint PDF may be factorized into a product of multiple conditional PDFs, each of which corresponds to a sampling routine. Analytic importance sampling may be performed for isotropic scattering, whereas tabulated importance sampling may be performed for anisotropic scattering.

Methods and systems of joint path importance sampling

The disclosure provides an approach for determining, in 3D rendering, the integrals of visibility-masked spherical functions using visibility silhouettes. For a given shade point, the visibility silhouette for that shade point includes a set of edges from the scene geometry which form the boundaries between visible and invisible regions of a hemisphere having the shade point as its center. For each shade point, a rendering application determines a set of contour edges of scene geometry, the contour edges being a superset of the set of visibility silhouette edges, by querying a 4D dual mesh. The rendering application then evaluates the integral of the visibility-masked spherical function for a given shade point by integrating over segments of discrete u-isolines for which an overlap function indicates that a ray from the shade point would not intersect scene geometry.

Visibility silhouettes for masked spherical integration

A method for creating artistic effects for volumetric illumination in a scene is provided. Data representing a scene is received. User input is received, which specifies a target appearance of the scene, including illumination effects that are at least in part non-physically-based. Photon beams representing volumetric illumination in the scene are generated; this step may incorporate user input-based modifications of the photon beams. Shading associated with the photon beams is computed; this step may also incorporate user input-based modifications. Any modifications in the generating or computing steps are derived from the specified target appearance of the scene. Finally, the photon beams are rendered.

Programmable system for artistic volumetric lighting

A method for rendering radiance for a volumetric medium is provided. A photon simulation produces a representation of photon beams in a scene. The photon beams are rendered with respect to a camera viewpoint, by computing an estimated radiance associated with the photon beams. A global radius scaling factor can be applied to obtain different radii for the photon beams. Over multiple applications of these steps, the global radius scaling factor can be decreased, thereby reducing overall error by facilitating convergence. Finally, the renderer can be efficiently implemented on the GPU as a splatting operation, for use in interactive and real-time applications.

Image processing using progressive generation of intermediate images using photon beams of varying parameters

Techniques for displaying content using an augmented reality device are described. Embodiments provide a visual scene for display, the visual scene captured using one or more camera devices of the augmented reality device. Embodiments adjust physical display geometry characteristics of the visual scene to correct for optimal projection. Additionally, illumination characteristics of the visual scene are modified based on environmental illumination data to improve realism of the visual scene when it is displayed. Embodiments further adjust display characteristics of the visual scene to improve tone mapping output. The adjusted visual scene is then output for display on the augmented reality device.

Virtual lens-rendering for augmented reality lens

Techniques are described for designing and manufacturing a refractive surface that produces a desired image when placed over a target image. The refractive lens surface may include a set of lens patches, each of which indexes a region on the source image to refract light from the indexed region to recreate a patch of the target image. And together, the lenses reproduce the target image. In one embodiment, the refractive geometry of the lens surface (i.e., the shape of each lens) is determined by formulating and efficiently determining a solution to an inverse light transport problem. The solution may account for additional constraints imposed by the physical manufacturing procedure. Doing so results in a design for a refractive surface amenable to milling (or other manufacturing process).

Refractive steganography lens and method for determining milling plan for same

A method and system for progressively rendering radiance for a volumetric medium is provided. A photon simulation produces a representation of photon beams in a scene. The photon beams are rendered with respect to a camera viewpoint, by computing an estimated radiance associated with the photon beams. A global radius scaling factor is applied to the photon beams. Over multiple iterations of these steps, the global radius scaling factor is progressively decreased, thereby reducing overall error by facilitating convergence. This order can be mixed up. Finally, the renderer can be efficiently implemented on the GPU as a splatting operation, for use in interactive and real-time applications.

Image processing using iterative generation of intermediate images using photon beams of varying parameters

Growing community of inventors

Menlo Park, CA, United States of America

Derek Nowrouzezahrai