Nvidia Corporation

Mark Hairgrove

Jerome Francis Duluk, Jr

Cameron Buschardt

Lucien Dunning

James Leroy Deming

John Mashey

Brian Matthew Fahs

Chenghuan Jia

Samuel Hammond Duncan

Robert T George

Arvind Gopalakrishnan

Sherry Cheung

Vivek Kini

Stephen Jones

Vyas Venkataraman

Timothy John Purcell

David Fontaine

Nick Barrow-Williams

John Hubbard

Piotr Jaroszynski

James M Van Dyke

Mark Alan Overby

Wishwesh Anil Gandhi

Naveen Cherukuri

Jonathon Stuart Ramsey Evans

Michael Asbury Woodmansee

Gobikrishna Dhanuskodi

Sudeshna Guha

Geoffrey Gerfin

Philip John Rogers

Dwayne Frank Swoboda

Steven E Molnar

Lacky V Shah

Liang Yin

Karan Mehra

Jaydeep Marathe

Christopher Frederick Lamb

Bastiaan Aarts

Jeffrey M Smith

Hemayet Hossain

Jonathon Stuart Ramsay Evans

Sujoyita Kaushikkar

Mayank Kaushik

Alban Douillet

Riley Andrews

Sami Olavi Johannes Kiminki

Daniel Glenn Robinson

Anup Holey

Alexander Michael Waterman

Jeff Smith

Piyush Patel

Vikram Sethi

Terje Bergstrom

Various embodiments include techniques for accessing extended memory in a parallel processing system via a high-bandwidth path to extended memory residing on a central processing unit. The disclosed extended memory system extends the directly addressable high-bandwidth memory local to a parallel processing system and avoids the performance penalties associated with low-bandwidth system memory. As a result, execution threads that are highly parallelizable and access a large memory space execute with increased performance on a parallel processing system relative to prior approaches.

High bandwidth extended memory in a parallel processing system

A processing device including a first cache is coupled to a system memory and a parallel processing unit (PPU) including a second cache. An operation to modify cache lines of the second cache associated with a first aperture of the system memory is received. A first subset of cache lines of the second cache is identified. The first subset of cache lines is associated with the first aperture of the system memory and is different from a second subset of cache lines of a second aperture of the system memory. The first subset of cache lines is modified as specified by the cache operation.

Systems and methods for aperture-specific cache operations

Apparatuses, systems, and techniques to generate a trusted execution environment including multiple accelerators. In at least one embodiment, a parallel processing unit (PPU), such as a graphics processing unit (GPU), operates in a secure execution mode including a protect memory region. Furthermore, in an embodiment, a cryptographic key is utilized to protect data during transmission between the accelerators.

Implementing trusted executing environments across multiple processor devices

Secure execution for multiple processor devices using trusted executing environments

The present invention facilitates efficient and effective utilization of unified virtual addresses across multiple components. In one exemplary implementation, an address allocation process comprises: establishing space for managed pointers across a plurality of memories, including allocating one of the managed pointers with a first portion of memory associated with a first one of a plurality of processors; and performing a process of automatically managing accesses to the managed pointers across the plurality of processors and corresponding memories. The automated management can include ensuring consistent information associated with the managed pointers is copied from the first portion of memory to a second portion of memory associated with a second one of the plurality of processors based upon initiation of an accesses to the managed pointers from the second one of the plurality of processors.

Unified memory systems and methods

A system for managing virtual memory. The system includes a first processing unit configured to execute a first operation that references a first virtual memory address. The system also includes a first memory management unit (MMU) associated with the first processing unit and configured to generate a first page fault upon determining that a first page table that is stored in a first memory unit associated with the first processing unit does not include a mapping corresponding to the first virtual memory address. The system further includes a first copy engine associated with the first processing unit. The first copy engine is configured to read a first command queue to determine a first mapping that corresponds to the first virtual memory address and is included in a first page state directory. The first copy engine is also configured to update the first page table to include the first mapping.

Fault buffer for tracking page faults in unified virtual memory system

Techniques are disclosed for tracking memory page accesses in a unified virtual memory system. An access tracking unit detects a memory page access generated by a first processor for accessing a memory page in a memory system of a second processor. The access tracking unit determines whether a cache memory includes an entry for the memory page. If so, then the access tracking unit increments an associated access counter. Otherwise, the access tracking unit attempts to find an unused entry in the cache memory that is available for allocation. If so, then the access tracking unit associates the second entry with the memory page, and sets an access counter associated with the second entry to an initial value. Otherwise, the access tracking unit selects a valid entry in the cache memory; clears an associated valid bit; associates the entry with the memory page; and initializes an associated access counter.

PCIe traffic tracking hardware in a unified virtual memory system

Fault buffer for resolving page faults in unified virtual memory system

One embodiment of the present invention includes a microcontroller coupled to a memory management unit (MMU). The MMU is coupled to a page table included in a physical memory, and the microcontroller is configured to perform one or more virtual memory operations associated with the physical memory and the page table. In operation, the microcontroller receives a page fault generated by the MMU in response to an invalid memory access via a virtual memory address. To remedy such a page fault, the microcontroller performs actions to map the virtual memory address to an appropriate location in the physical memory. By contrast, in prior-art systems, a fault handler would typically remedy the page fault. Advantageously, because the microcontroller executes these tasks locally with respect to the MMU and the physical memory, latency associated with remedying page faults may be decreased. Consequently, overall system performance may be increased.

Microcontroller for memory management unit

A technique for simultaneously executing multiple tasks, each having an independent virtual address space, involves assigning an address space identifier (ASID) to each task and constructing each virtual memory access request to include both a virtual address and the ASID. During virtual to physical address translation, the ASID selects a corresponding page table, which includes virtual to physical address mappings for the ASID and associated task. Entries for a translation look-aside buffer (TLB) include both the virtual address and ASID to complete each mapping to a physical address. Deep scheduling of tasks sharing a virtual address space may be implemented to improve cache affinity for both TLB and data caches.

Efficient memory virtualization in multi-threaded processing units

Migration scheme for unified virtual memory system

Growing community of inventors

San Jose, CA, United States of America

Mark Hairgrove