Canon Kabushiki Kaisha

Anthony Knittel

Tuan Hue Thi

The present disclosure provides a method of recognising a first action. The method comprises determining a weighted combination of a first plurality of feature responses associated with a sequence of second actions over a period of time using a set of weights at a particular time instance in the period of time. The method then recognises the first action by processing, using a neural network, the weighted combination of the first plurality of feature responses and temporal position values of each of the first plurality of feature responses associated with the sequence of second actions.

Relative position encoding based networks for action recognition

A system and method of training an artificial neural network. The method comprises determining an activation value for each node in a set of nodes of the artificial neural network, the activation values being determined by applying training data to the artificial neural network, and scaling the determined activation values for each of a plurality of the nodes in a portion of the artificial neural network. Each scaled activation value is determined using a scaling factor associated with a corresponding one of the plurality of nodes. Each scaling factor is determined based on a rank of the corresponding node. The method further comprises updating weights associated with each of the plurality of nodes in the portion of the artificial neural network using the determined scaled activation values to train the neural network.

Method for training an artificial neural network by scaling activation values

A method of classifying an action or event using an artificial neural network. The method comprises obtaining a first and a second plurality of feature responses, corresponding to point data in a first channel and a second channel respectively. Each of the first and second plurality of feature responses have associated temporal and spatial position values, the first and second plurality of feature responses relating to a plurality of objects. The method also comprises generating a third plurality of feature responses based on one of the first plurality of feature responses and one of the second plurality of feature responses, and a weighted combination of associated temporal and spatial position values of the corresponding one of the first and second plurality of feature responses; and classifying an action or event relating to the objects using the artificial neural network based on the third plurality of feature responses.

System and method of classifying an action or event

A method of determining a spatio-temporal feature value for frames of a sequence of video. A first frame and second frame from the sequence of video are received. Spatial feature values in each of the first and second frames are determined according to a plurality of spatial feature functions. For each of the spatial feature functions, a change in the spatial feature values between the first and second frames is determined. The spatio-temporal feature value is determined by combining the determined change in spatial feature values for each of the spatial feature functions.

Spatio-temporal features for video analysis

A method of training an artificial neural network The artificial neural network comprising a plurality of connections connecting nodes arranged in at least an initial and a subsequent layer. The method comprises receiving a training example, the training example having input values, a target, and an associated training salience value indicating an importance of the input values to determining the target. The method further comprises determining salience values for nodes of the initial layer from the training salience value; determining an activation value for at least one node of the subsequent layer by propagating the input values using a subset of the connections selected based on the determined salience values for the nodes of the initial layer; and training the artificial neural network using the activation value, the trained artificial neural network configured to determine a relationship between the input data values and the target.

Growing community of inventors

Maroubra, Australia

Anthony Knittel