Naver Corporation

Jérôme Revaud

Boris Chidlovskii

Philippe Weinzaepfel

Cordelia Luise Schmid

Rafael Sampaio De Rezende

Vincent Leroy

Vasileios Choutas

A method for detecting a point of interest (POI) change in a pair of inputted POI images. A first processor of the method: generates triplets of training POI images using a base of training POI images and trains a convolutional neural network (CNN) of three-stream Siamese type based on the triplets of training POI images. A second processor of the method: computes, for each image of the pair of inputted POI images, a descriptor of that image using a stream of the CNN of three-stream Siamese type, computes a similarity score based on the descriptors of the images of the pair of inputted POI images using a similarity score function, and selectively detects the POI change based on the similarity score. A third processor of the method generates the base of training POI images to include an initial set of POI images and a set of synthetic POI images.

Systems and methods for detecting a point of interest change using a convolutional neural network

A method for training a convolutional neural network for classification of actions performed by subjects in a video is realized by (a) for each frame of the video, for each key point of the subject, generating a heat map of the key point representing a position estimation of the key point within the frame; (b) colorizing each heat map as a function of the relative time of the corresponding frame in the video; (c) for each key point, aggregating all the colorized heat maps of the key point into at least one image representing the evolution of the position estimation of the key point during the video; and training the convolutional neural network using as input the sets associated to each training video of images representing the evolution of the position estimation of each key point during the video.

System and method for training a convolutional neural network and classifying an action performed by a subject in a video using the trained convolutional neural network

Growing community of inventors

Meylan, France

Jérôme Revaud