Adobe, Inc.

Daniel O'Donnell

David P Simons

James Acquavella

John G Carscadden

A method, system, and computer-readable storage medium are disclosed for time-based degradation of images. In one embodiment, the rendering of a first frame of a digital video using a GPU may be initiated. In one embodiment, it may be determined that a time elapsed in rendering the first frame exceeds a threshold. In one embodiment, a downsampling factor may be determined in response to determining that the time elapsed exceeds the threshold. In one embodiment, a second frame of the digital video comprising a second set of one or more images may be rendered based on the downsampling factor using the GPU. Rendering the second frame based on the downsampling factor may comprise sending each of the second set of images to the GPU at a reduced resolution comprising a respective original resolution for each image divided by the downsampling factor.

Time-based degradation of images using a GPU

A computer-implemented method includes identifying a intersection point on a first graphical object from an incident ray. The incident ray originates from an image viewpoint. The method also includes directing a compositing ray from the image viewpoint to the intersection point. Further, the method includes determining color information associated with the intersection point from color information provided by the compositing ray.

Image compositing with ray tracing

A method to perform compositing of three-dimensional images includes, on a Central Processing Unit (CPU), automatically assembling a Graphics Processing Unit (GPU) program for each element of a plurality of image elements. The GPU program for each element is to apply at least one effect to the respective image element. The plurality of image elements, and the associated GPU programs, is communicated from the CPU to a GPU.

GPU assisted 3D compositing

A method, system, and computer-readable storage medium are disclosed for rendering a scene with a simulated depth of field blur. In one embodiment, the scene comprises a plurality of polygons, each polygon comprises a respective plurality of vertices, and each of the vertices has a respective depth. A respective blur radius may be determined for each vertex of each polygon as a function of the depth of the vertex. A respective blur radius may be determined for each pixel in each polygon based on the blur radii for the vertices of the polygon. Each pixel in each polygon may be rendered using the respective blur radius determined for the pixel.

Fast depth of field simulation

Shadows from physical lights have a penumbra region, in which the light is only partially hidden from the shadow acceptor. The intensity of light in this region may be calculated using an approximation of the amount of light visible. For example a fragment or pixel shader program execution on a GPU may generate a shadow from a light source using the light intensities for each pixel being rendered. Per-pixel shadow density information may be projected from the shadow caster onto the shadow acceptor. A penumbra map may contain both depth information and light attenuation information for the shadow acceptor. This information may be blurred using a fragment or pixel shader on a GPU to determine an average shadow density for a pixel being rendered.

Calculating shadow from area light sources using a spatially varying blur radius

A method includes identifying a plurality of image elements to be rendered within a three-dimensional image. The method also includes identifying a set of light sources according to which lighting and shadowing are to be computed within the three-dimensional image. For each image elements of the plurality of image elements, the method includes generating a shaded image element, wherein the generating of the shaded image element includes rendering the respective image element into a buffer for each light source of the set of light sources so as to accumulate lighting effects, particular to the image element, within the buffer as the shaded image element. For each image element of the plurality of image elements, the method includes rendering at least one effect with respect to the shaded image element to generate a modified image element.

Three-dimensional image compositing on a GPU utilizing multiple transformations

A method to perform compositing of three-dimensional images includes, on a Central Processing Unit (CPU), automatically assembling a Graphics Processing Unit (GPU) program for each element of a plurality of image elements. The GPU program for each element is to apply at least one effect to the respective image element, and to composite the respective image element according to a compositing mode specific to the respective image element. The plurality of image elements, and the associated GPU programs, is communicated from the CPU to a GPU. The plurality of image elements may be subject to a two-pass sort operation prior to the automatic assembly of the GPU programs.

A method includes performing a first transform operation with respect to an image element to transform the image element from an object space, defined by an object coordinate system, to an intermediate space defined by an intermediate coordinate system. A first computational operation is performed with respect to the image element in the intermediate space. A second transform operation is performed with respect to the image element to transform the image element from the intermediate space to a world space, defined by a world coordinate system. A second computational operation is performed with respect to the image element in the world space.

Systems, methods and apparatus, including computer program products, implementing and using techniques for generating a composite image from both two-dimensional (2D) image layers and three-dimensional (3D) image layers. In one embodiment, the image layers are arranged in a sequence. The image layers are rendered according to the sequence to generate a composite image, the last image layer of the sequence to be rendered being a 2D image layer.

Compositing two-dimensional and three-dimensional image layers

Methods and apparatus, including computer program products, implementing and using techniques for generating a composite image from both two-dimensional (2D) image layers and three-dimensional (3D) image layers. In one embodiment, the image layers are arranged in a sequence in which a top 3D image layer is separated from a bottom 3D image layer by a 2D image layer and the image layers are rendered according to the sequence. In another embodiment, at least one of the image layers is associated with an adjustment layer, and rendering the composite image includes determining whether each current image layer has an associated adjustment layer with a dimensionality different from that of the current image layer, and if it does, applying the adjustment layer accordingly. In another embodiment, at least one of the image layers is associated with a track matte.

Methods and apparatus, including computer program products, implementing and using techniques for generating a composite image. Electronic data representing image layers to be combined in a composite image is provided. At least one of the image layers has two-dimensional content. At least one of the image layers has three-dimensional content. The layers are arranged in a composition sequence list. The image layers are grouped into metalayers including image layers with content of a common dimensionality. The metalayers are arranged in a metalayer sequence. A metalayer is selected according to the metalayer sequence and the image layers in the selected metalayer are processed to generate a raster representation of the image layers in the selected metalayer. The raster representation is composited into an image buffer and the process is repeated until the raster representation of each of the metalayers have been composited into the image buffer to form a composite image.

Growing community of inventors

Seattle, WA, United States of America

Daniel O'Donnell