Advanced New Technologies Co., Ltd.

Alibaba Group Holding Limited

Advantageous New Technologies Co., Ltd.

Qiyin Huang

Yongchao Liu

Haitao Zhang

Guozhen Pan

Jianguo Xu

Guanyin Zhu

Sizhong Li

Lin Wang

Chengping Yang

Implementations of the present specification provide a model-based prediction method and apparatus. The method includes: a model running environment receives an input tensor of a machine learning model; the model running environment sends a table query request to an embedding running environment, the table query request including the input tensor, to request low-dimensional conversion of the input tensor; the model running environment receives a table query result returned by the embedding running environment, the table query result being obtained by the embedding running environment by performing embedding query and processing based on the input tensor; and the model running environment inputs the table query result into the machine learning model, and runs the machine learning model to complete model-based prediction.

Separate deployment of machine learning model and associated embedding

An example method for updating convolutional neural network includes: obtaining a sample with a classification label; performing a first operation on the sample based on parameters of each layer of front-end network, to obtain a first operation result; performing a second operation on the sample based on the first operation result and the parameters of each layer of back-end network that the first GPU has, to obtain a second operation result; separately sending the first operation result to the other GPUs; receiving a third operation result obtained after each other GPU performs a third operation on the sample based on their parameters of each layer of back-end network and the first operation result; combining the second and third operation results to obtain a classification result; determining a prediction error based on the classification result and the classification label; and updating the convolutional neural network based on the prediction error.

Method, apparatus and device for updating convolutional neural network using GPU cluster

Embodiments of the present specification provide chips and chip-based data processing methods. In an embodiment, a method comprises: obtaining data associated with one or more neural networks transmitted from a server; for each layer of a neural network of the one or more neural networks, configuring, based on the data, a plurality of operator units based on a type of computation each operator unit performs; and invoking the plurality of operator units to perform computations, based on neurons of a layer of the neural network immediately above, of the data for each neuron to produce a value of the neuron.

Chip and chip-based data processing method

A computer-implemented method includes obtaining a trained convolutional neural network comprising one or more convolutional layers, each of the one or more convolutional layers comprising a plurality of filters with known filter parameters; pre-computing a reusable factor for each of the one or more convolutional layers based on the known filter parameters of the trained convolutional neural network; receiving input data to the trained convolutional neural network; computing an output of the each of the one or more convolutional layers using a Winograd convolutional operator based on the pre-computed reusable factor and the input data; and determining output data of the trained convolutional network based on the output of the each of the one or more convolutional layers.

Fast computation of a convolutional neural network

Growing community of inventors

Hangzhou, China

Qiyin Huang