Apple Inc.

Caustic Graphics, Inc.

Imagination Technologies Limited

Ryan R Salsbury

Luke Tilman Peterson

James Alexander McCombe

Hyeonkuk Jeong

Stephen C Purcell

Steven John Clohset

James O Normile

Joe S Abuan

Sean Matthew Gies

Berkat S Tung

Jim Normile

Adriana Dumitras

Barin Geoffry Haskell

Jeffrey Chandler Moore

James A Mccombe

Stephen John Clohset

Gerhard Hermann Johannes Lengeling

Berkat Shing Tung

Ray tracing, and more generally, graphics operations taking place in a 3-D scene, involve a plurality of constituent graphics operations. Responsibility for executing these operations can be distributed among different sets of computation units. The sets of computation units each can execute a set of instructions on a parallelized set of input data elements and produce results. These results can be that the data elements can be categorized into different subsets, where each subset requires different processing as a next step. The data elements of these different subsets can be coalesced so that they are contiguous in a results set. The results set can be used to schedule additional computation, and if there are empty locations of a scheduling vector (after accounting for the members of a given subset), then those empty locations can be filled with other data elements that require the same further processing as that subset.

Ray tracing in computer graphics using intersection testing at selective resolution

Aspects comprise systems implementing 3-D graphics processing functionality in a multiprocessing system. Control flow structures are used in scheduling instances of computation in the multiprocessing system, where different points in the control flow structure serve as points where deferral of some instances of computation can be performed in favor of scheduling other instances of computation. In some examples, the control flow structure identifies particular tasks, such as intersection testing of a particular portion of an acceleration structure, and a particular element of shading code. In some examples, the aspects are used in 3-D graphics processing systems that can perform ray tracing based rendering.

Ray tracing system architectures and methods

Aspects comprise systems implementing 3-D graphics processing functionality in a multiprocessing system. Control flow structures are used in scheduling instances of computation in the multiporcessing system, where different points in the control flow structure serve as points where deferral of some instances of computation can be performed in favor of scheduling other instances of computation. In some examples, the control flow structure identifies particular tasks, such as intersection testing of a particular portion of an acceleration structure, and a particular element of shading code. In some examples, the aspects are used in 3-D graphics processing systems that can perform ray tracing based rendering.

Compacting results vectors between stages of graphics processing

Aspects can be for ray tracing of 3-D scenes, and include dynamically controlling a population of rays being stored in a memory, to keep the population within a target, a memory footprint or other resource usage specification. An example includes controlling the population by examining indicia associated with rays returning from intersection testing, to be shaded, the indicia correlated with behavior of shaders to be run for those rays, such that population control selects, or reorders rays for shading, to prioritize shading of rays whose shaders are expected to produce fewer rays.

Dynamic graphics rendering scheduling

A processor supports special-purpose instructions relating to testing rays for intersection with geometry and acceleration structure elements. The processor can be a full-featured processor; the special-purpose instructions can be differentiated from other supported instructions. The processor can have an instruction generator coupled with an instruction decoder, a data cache, a fetch unit, and a set of test cells for performing computations indicated by special-purpose instructions. Separate test cells can test rays with scene geometry and with acceleration structure elements; different instructions can be provided for each type of testing. The data cache is coupled to the test cells; the instruction decoder also provides input to the test cells while the test cells are coupled to a write back unit that is coupled to the data cache and to the instruction generator. In an example, the instruction decoder supplies ray references from an instruction as functional addresses to the data cache.

Processor with ray test instructions performed by special purpose units

Aspects include API interfaces for interfacing shaders with other components and/or code modules that provide ray tracing functionality. For example, API calls may allow direct contribution of light energy to a buffer for an identified pixel, and allow emission of new rays for intersection testing alone or in bundles. The API also can provide a mechanism for associating arbitrary data with ray definition data defining a ray to be tested through a shader using the emit ray call. The arbitrary data is provided to a shader associated with an object that is identified subsequently as having been intersected by the ray. The data can include code, or a pointer to code, that can be used by or run after the shader. The data also can be propagated through a series of shaders, and associated with rays instantiated in each shader. Recursive shaders can be recompiled as non-recursive shaders interfacing with API semantics according to the description.

Systems and methods for program interfaces in multipass rendering

Some embodiments provide an architecture for establishing a multi-participant conference. This architecture has one participant's computer in the conference act as a central content distributor for the conference. The central distributor receives data (e.g., video and/or audio streams) from the computer of each other participant, and distributes the received data to the computers of all participants. In some embodiments, the central distributor receives A/V data from the computers of the other participants. From such received data, the central distributor of some embodiments generates composite data (e.g., composite image data and/or composite audio data) that the central distributor distributes back to the participants.

Multi-participant conference setup

For ray tracing scenes composed of primitives, systems and methods can traverse rays through an acceleration structure. The traversal can be implemented by concurrently testing a plurality of nodes of the acceleration structure for intersection with a sequence of one or more rays. Such testing can occur in a plurality of test cells. Leaf nodes of the acceleration structure can bound primitives, and a sequence primitives can be tested concurrently for intersection in the test cells against a plurality of rays that have intersected a given leaf node. Intersection testing of a particular leaf node can be deferred until a sufficient quantity of rays have been collected for that node.

Growing community of inventors

San Francisco, CA, United States of America

Ryan R Salsbury