Mitsubishi Electric Research Laboratories, Inc.

Matthias Zwicker

Hanspeter Pfister

Markus H Gross

Wojciech Matusik

Anthony Vetro

Sehoon Yea

Jeroen Van Baar

Liu Ren

Wei Ye Chen

Fredo Durand

A method and system acquire and display light fields. A continuous light field is reconstructed from input samples of an input light field of a 3D scene acquired by cameras according to an acquisition parameterization. The continuous light is reparameterized according to a display parameterization and then prefiltering and sampled to produce output samples having the display parametrization. The output samples are displayed as an output light field using a 3D display device. The reconstruction can be performed by interpolating the input samples having the different views.

Method and system for decoding and displaying 3D light fields

A method and system acquire and display light fields. A continuous light field is reconstructed from input samples of an input light field of a 3D scene acquired by cameras according to an acquisition parameterization. The continuous light is reparameterized according to a display parameterization and then prefiltering and sampled to produce output samples having the display parameterization. The output samples are displayed as an output light field using a 3D display device. The reconstruction can be performed by interpolating the input samples having the different views.

Method and system for acquiring, encoding, decoding and displaying 3D light fields

A method and system acquire and display light fields. A continuous light field is reconstructed from input samples of an input light field of a 3D scene acquired by cameras according to an acquisition parameterization. The continuous light is reparameterized according to a display parameterization and then prefiltering and sampled to produce output samples having the display parametrization. The output samples are displayed as an output light field using a 3D display device.

Method and system for acquiring and displaying 3D light fields

A method renders a volume data set including a plurality of voxels. A sampling rate for each voxel in a volume data set is determined. Each voxel is filtered according to the sampling rate and pixels for an output image are generated from the filtered voxels.

Sample rate adaptive filtering for volume rendering

A method renders a 3D model of a graphics object wherein the model includes discrete zero-dimensional points. A first opaque polygon is centered on each point, and the polygon is rendered to obtain depth values of a depth image in a z-buffer. A second polygon is centered on each point. The second polygons are adapted to associated object space EWA resampling filters, and the adapted second polygons are rendered as an image according to the depth values in the depth image.

Object space EWA splatting of point-based 3D models

A method produces an image from a set of discrete sample points. The sample points can define a 3D volume or surface. Each discrete sample point is projected to a screen space. A continuous resampling filter for each sample point is generated in screen space. The continuous resampling filter is a combination of a continuous reconstruction function and a continuous filter function for the sample point in screen space. The continuous resampling filter is then applied to each corresponding discrete sample in the screen space to generate a continuous sample for the image. The continuous samples can be rasterized to pixels using any known rasterization process or method.

Rendering discrete sample points projected to a screen space with a continuous resampling filter

In a method for projecting surface points of a graphic object onto pixels in a depth buffer to determine depth values of the pixels, each surface point is projected onto a corresponding pixels. A depth value of each projected surface point is stored in the pixel only if the depth value of the projected surface point is less than the depth value of the pixel. A tangential disk is constructed at a position of the surface point, the tangential disk has a radius larger than a maximum distance between the surface points. The tangential disk is projected onto a corresponding subset of the pixels. Depth values of the projected tangential disk are stored in the corresponding subsets of pixels only if the depth values of the projected tangential disk are less than the depth values of the corresponding subsets of pixels.

Visibility splatting and image reconstruction for surface elements

A rendering system pipeline includes a memory storing shape and shade attributes of a surface of the object. The attributes are arranged as an octree in the memory. The octree includes a plurality of nodes arranged at a plurality of levels, each node storing a plurality of zero-dimensional n-tuples, each n-tuple locally approximating the shape and shade attributes of a portion of the surface of the graphic object, and the n-tuples having a sampling resolution of an image space. A plurality of parallel processing pipelines are connected the memory. The pipelines project the shape and shade attributes of the octree to an image plane having a selected orientation by traversing the n-tuples of the nodes of the octree from a lowest resolution level to a highest resolution level.

Rendering pipeline for surface elements

In a method for representing a graphic object, rays are cast through the object. The rays originate at orthogonal planes surrounding the object. The surface of the object is sampled for shape and shade attributes at points where the rays intersect the surface. The sampled shape and shade attributes of each sampled point are stored in an octree stored in the memory.

Hierarchical data structures for surface elements

In a method for filtering shade attributes of surface points of a graphic object onto pixels in an image buffer according to depth values stored in a depth buffer, tangential disks are constructed at positions of each surface point. The tangential disks have increasingly larger radii. Each tangential disk is projected to an ellipse in texture space. View independent filter functions are applied at the position of each surface point to generate texture mipmaps for the surface point. The filter functions have an extent equal to the projected tangential disk. The surface point is projected to the pixels in the depth buffer, and a view dependent filter function is applied to each pixel in the image buffer to determine colors for the pixels.

Growing community of inventors

Gerlikon, Switzerland

Matthias Zwicker