Learning method and learning device for generating training data from virtual data on virtual world by using generative adversarial network, to thereby reduce annotation cost required in training processes of neural network for autonomous driving, and a testing method and a testing device using the same

Abstract

A learning method for transforming a virtual video on a virtual world to a more real-looking video is provided. And the method includes steps of: (a) a learning device instructing a generating CNN to apply a convolutional operation to an N-th virtual training image, N-th meta data and (N-K)-th reference information to generate an N-th feature map; (b) the learning device instructing the generating CNN to apply a deconvolutional operation to the N-th feature map to generate an N-th transformed image; (c) the learning device instructing a discriminating CNN to apply a discriminating CNN operation to the N-th transformed image to generate a category score vector; (d) the learning device instructing the generating CNN to generate a generating CNN loss by referring to the category score vector and its corresponding GT, and to perform backpropagation by referring to the generating CNN loss to learn parameters of the generating CNN.