Targeted data augmentation using neural style transfer

Abstract

A method for training a deep neural network (DNN) to perform a specified task with respect to images captured by a target camera, including: using an image captured by the target camera as a style target image, training a style transformer network to perform a style transformation that transforms any photorealistic input image into a transformed image that has contents of the input image, maintains photorealistic quality of the input image, and has a style that matches a style of the style target image; using the trained style transformer network to transform training image of an original training dataset into transformed training images; labeling the transformed training images with the training labels of the corresponding training image of the original training dataset, to form an augmented training dataset; and using the augmented training dataset to train the DNN to perform the specified task.