The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jan. 23, 2024

Filed:

Jun. 26, 2018
Applicant:

International Business Machines Corporation, Armonk, NY (US);

Inventors:

Yasushi Negishi, Tokyo, JP;

Haruki Imai, Kanagawa, JP;

Taro Sekiyama, Chiba, JP;

Tung D. Le, Chiba, JP;

Kiyokuni Kawachiya, Kanagawa, JP;

Attorneys:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2023.01); G06N 3/063 (2023.01); G06F 9/50 (2006.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01); G06F 9/5016 (2013.01); G06N 3/063 (2013.01);
Abstract

A computer-implemented method, a computer program product, and a computer processing system are provided for selecting from among multiple Graphics Processing Unit (GPU) execution modes for a Neural Network (NN) having a size greater than a threshold size. The multiple GPU execution modes include a normal memory mode, an Out-of-Core (OoC) execution mode, and a Unified Memory (UM) mode. The method includes starting an execution on the NN with the UM mode and measuring the memory usage for each of layers of the NN. The method further includes selecting an execution mode based on the memory usage of all of the layers.


Find Patent Forward Citations

Loading…