Intel Corporation

Prashant Arora

Aravind Kalaiah

Olivia Wu

Tony Lee Werner

Andrew Yang

Amir Khosrowshahi

Carey Kevin Kloss

Vijay Anand R Korthikanti

Naveen Gandham Rao

Jason Ko

Olivia K Wu

Horace H Lau

One embodiment provides an apparatus. The apparatus may include memory circuitry to store tensor data representing a tensor. The apparatus may include memory controller circuitry to access the memory circuitry. The apparatus may include processor circuitry to: receive a request for a tensor operation; generate a plurality of sub-commands for the tensor operation; and provide the sub-commands to memory controller circuitry to perform the tensor operation based on instructions contained in one or more of the sub-commands. The instructions contained in one or more of the sub-commands may include identify addresses in memory to access; activate one or more rows in the memory circuitry that correspond to the addresses; and transfer tensor data to and/or from the memory circuitry.

Memory subsystem operations with unaligned and scatter gather feature to support convolution and dimension shuffle

Described herein are methods, systems, and apparatuses to utilize a matrix operation by accessing each of the operation's matrix operands via a respective single memory handle. This use of a single memory handle for each matrix operand eliminates significant overhead in memory allocation, data tracking, and subroutine complexity present in prior art solutions. The result of the matrix operation can also be accessible via a single memory handle identifying the matrix elements of the result.

Matrix operands for linear algebra operations

Growing community of inventors

Fremont, CA, United States of America

Prashant Arora