Advanced Micro Devices Corporation

Nuwan S Jayasena

Shaizeen Dilawarhusen Aga

Gabriel H Loh

James Michael O'Connor

Yasuko Eckert

Michael Ignatowski

Michael J Schulte

Michael Mantor

Manish Arora

Alexander Dodd Breslow

Johnathan R Alsop

John Kalamatianos

Kevin John McGrath

Rex Eldon McCrary

Philip J Rogers

Sooraj Puthoor

Mark M Leather

Sebastien Nussbaum

Robert Scott Hartog

Lisa R Hsu

David Andrew Roberts

Ralph Clay Taylor

Thomas R Woller

Dong Ping Zhang

Bradford Michael Beckmann

Amin Farmahini-Farahani

Andrew Gregory Kegel

Srilatha Manne

Allen H Rush

Michael Warren Boyer

Ashwin Aji

Michael L Chu

Amin Farmahini Farahani

Muhammad Amber Hassaan

Yi Xu

Sudhanva Gurumurthi

Alexandru Dutu

William Lloyd Bircher

Madhu Saravana Sibi Govindan

Shrikanth Ganapathy

Yuan Xie

Niladrish Chatterjee

Niti Madan

Mahzabeen Islam

Indrani Paul

Vilas K Sridharan

Jagadish B Kotra

Mohamed Assem Abd ElMohsen Ibrahim

Reena Panda

Paula Aguilera Diez

Anirban Nag

Andrew McCrabb

Mauricio Breternitz, Jr

Anthony T Gutierrez

Mithuna Shamabhat Thottethodi

Arkaprava Basu

Onur Kayiran

Mitesh Ramesh Meswani

Jayanth Gummaraju

Nicholas P Malaya

Ralph Clayton Taylor

Ross Voigt La Fetra

Brandon K Potter

Georgios Mappouras

Andreas Prodromou

Hyojong Kim

Hyesoon Kim

Farzad Khorasani

Jonathan Alsop

Suchita Pati

A memory controller coupled to a memory module receives both processing-in-memory (PIM) requests and memory requests from a host (e.g., a host processor). The memory controller issues PIM requests to one group of memory banks and concurrently issues memory requests to one or more other groups of memory banks. Accordingly, memory requests are performed on groups of memory banks that would otherwise be idle while PIM requests are performed on the one group of memory banks. Optionally, the memory controller coupled to the memory module also takes various actions when switching between operating in a PIM mode and a non-processing-in-memory mode to reduce or hide overhead when switching between the two modes.

Scheduling processing-in-memory requests and memory requests

To improve user engagement with media content, a processing system is configured to modify the media content based on one or more user profiles. To this end, the processing system includes one or more servers first configured to select media content from a database to present to a user. The servers are then configured to determine one or more likeness scores between the selected media content and a user profile associated with the user. Based on the comparison of the likeness scores to the user profile, the servers then modify the media content so as to increase one or more of the determined likeness scores. The servers then provide the modified media content to the user.

Media content modification using user profiles

Fused data generation and associated communication techniques are described. In an implementation, a system includes processing system having a plurality of processors. A data generation and communication tracking module is configured to track programmatically defined data generation and associated communication as performed by the plurality of processors. A targeted communication module is configured to trigger targeted communication of data between the plurality of processors based on the tracked programmatically defined data generation and associated communication.

Fused data generation and associated communication

Systems and techniques for data-driven precision memory access of cache block data are described. Computing system components are informed as to instances where access operations involve deducing a necessary precision of the data format and expressing the requested data in a lower-precision data format with minimal to no accuracy loss. In one example, executable code for a computational task includes hints that identify when memory requests involve accessing data in a numeric data format based on a deduced precision of the stored data during memory access. The described techniques thus overcome conventional drawbacks facing systems that transmit and compute data in a higher-precision data format than required by the stored values.

Data-driven precision for memory access

Programmable data storage memory hierarchy techniques are described. In one example, a data storage system includes a memory hierarchy and a data movement controller. The memory hierarchy includes a hierarchical arrangement of a plurality of memory buffers. The data movement controller is configured to receive a data movement command and control data movement between the plurality of memory buffers based on the data movement command.

Programmable data storage memory hierarchy

Modifying memory page attributes using a programmable page attribute register of a core executing a process is described. In accordance with the described techniques, a host includes a core that is configured to generate a modified page table attribute for a page in system memory. The modified page table attribute represents at least one demoted permission for a page as specified by a system page table. The core is configured to maintain the modified page table attribute locally in the programmable page attribute register and execute at least one operation allocated to the page according to the modified page table attribute.

Memory page attribute modification

Resource access control is described. In accordance with the described techniques, a process (e.g., an application process, a system process, etc.) issues an instruction seeking access to a computation resource (e.g., a processor resource, a memory resource, etc.) to perform a computation task. An execution context for the instruction is checked to determine whether the execution context includes a resource indicator indicating permission to access the processor resource. Alternatively or additionally, the instruction is checked against an access table which identifies processes that are permitted and/or not permitted to access the computation resource.

Resource access control

Process isolation for a PIM device through exclusive locking includes receiving, from a process, a call requesting ownership of a PIM device. The request includes one or more PIM configuration parameters. The exclusive locking technique also includes granting the process ownership of the PIM device responsive to determining that ownership is available. The PIM device is configured according to the PIM configuration parameters.

Process isolation for a processor-in-memory ('PIM') device

An integrated circuit device includes a memory controller coupleable to a memory. The memory controller to schedule memory accesses to regions of the memory based on memory timing parameters specific to the regions. A method includes receiving a memory access request at a memory device. The method further includes accessing, from a timing data store of the memory device, data representing a memory timing parameter specific to a region of the memory cell circuitry targeted by the memory access request. The method also includes scheduling, at the memory controller, the memory access request based on the data.

Memory system with region-specific memory access scheduling

Methods and apparatuses to control digital data transfer via a memory channel between a memory module and a processor are disclosed. At least one of the memory module or the processor coalesces a plurality of short data words into multicast coalesced block data comprising a single data block for transfer via the memory channel. Each of the plurality of short data words pertains to one of at least two partitioned memory submodules in the memory module. The multicast coalesced block data is communicated over the memory channel.

System and method for coalesced multicast data transfers over memory interfaces

An approach is provided for processing near-memory processing commands, e.g., PIM commands, using PIM register definition data that defines multiple combinations of source and/or destination registers to be used to process PIM commands. A particular combination of source and/or destination registers to be used to process a PIM command is specified by the PIM command or determined by a near-memory processing element processing the PIM command. According to another implementation, the PIM register definition data specifies an initial combination of source and/or destination registers and one or more update functions for each PIM command. A near-memory processing element processes a PIM command using the initial combination of source and/or destination registers and uses the one or more update functions to update the combination of source and/or destination registers to be used the next time the PIM command is processed.

Approach for processing near-memory processing commands using near-memory register definition data

Near-memory compute elements perform memory operations and temporarily store at least a portion of address information for the memory operations in local storage. A broadcast memory command is then issued to the near-memory compute elements that causes the near-memory compute elements to perform a subsequent memory operation using their respective address information stored in the local storage. This allows a single broadcast memory command to be used to perform memory operations across multiple memory elements, such as DRAM banks, using bank-specific address information. In one implementation, the approach is used to process workloads with irregular updates to memory while consuming less command bus bandwidth than conventional approaches. Implementations include using conditional flags to selectively designate address information in local storage that is to be processed with the broadcast memory command.

Approach for performing efficient memory operations using near-memory compute elements

In accordance with the described techniques for bank-level parallelism for processing in memory, a plurality of commands are received for execution by a processing in memory component embedded in a memory. The memory includes a first bank and a second bank. The plurality of commands include a first stream of commands which cause the processing in memory component to perform operations that access the first bank and a second stream of commands which cause the processing in memory component to perform operations that access the second bank. A next row of the first bank that is to be accessed by the processing in memory component is identified. Further, a precharge command is scheduled to close a first row of the first bank and an activate command is scheduled to open the next row of the first bank in parallel with execution of the second stream of commands.

Bank-level parallelism for processing in memory

An apparatus includes a memory controller that includes logic to receive a first memory request having a first request type and a second memory request having a second request type. The apparatus also includes a scheduling unit that includes logic to schedule an order of the first and second memory requests for execution based upon a first parameter value and a second parameter value. The first parameter value corresponds to a utility and energy cost for the first memory request and the second parameter value corresponds to a utility and energy cost for the second memory request.

Allocation of resources when processing at memory level through memory request scheduling

Predicates for processing in memory is described. In accordance with the described techniques, a predicate instruction to compute a conditional value based on data stored in a memory is provided to a processing-in-memory component. A response that includes the conditional value computed by the processing-in-memory component is received, and the conditional value is stored in a predicate register. One or more conditional instructions are provided to the processing-in-memory component based on the conditional value stored in the predicate register.

Predicates for processing-in-memory

Growing community of inventors

Santa Clara, CA, United States of America

Nuwan S Jayasena