Method and system of managing memory usage in a data learning operation

Abstract

Methods and systems for managing memory usage in data learning operations. The method includes profiling one or more objects used for training in the data learning operation, in which the profiling includes determining an object size, a memory allocation timestamp, and a memory deallocation timestamp; and scheduling the memory usage. The scheduling includes grouping the one or more objects into the one or more groups based on the memory allocation and/or the memory deallocation timestamp of the one or more objects, and arranging the one or more objects in the one or more groups in descending order in a memory space. Two or more objects are provided in the descending order in the memory space, in which one of the objects having an earliest memory allocation timestamp is provided at a first value and the other object having a later memory allocation timestamp is provided at a second value.