Stradvision, Inc.

Intel Corporation

Stradavision, Inc.

Bongnam Kang

Hongmo Je

Wooju Ryu

Yongjoong Kim

Sung An Gweon

Kye-Hyeon Kim

Hyungsoo Lee

Dongkyu Yu

A method for updating an object detector of an autonomous vehicle to adapt the object detector to a driving circumstance is provided. The method includes steps of: a learning device (a) (i) inputting a training image, corresponding to a driving circumstance, into a circumstance-specific object detector to apply (i-1) convolution to the training image to generate a circumstance-specific feature map, (i-2) ROI pooling to the circumstance-specific feature map to generate a circumstance-specific pooled feature map, and (i-3) fully-connected operation to the circumstance-specific pooled feature map to generate circumstance-specific object detection information and (ii) inputting the circumstance-specific feature map into a circumstance-specific ranking network to (ii-1) apply deconvolution to the circumstance-specific feature map and generate a circumstance-specific segmentation map and (ii-2) generate a circumstance-specific rank score via a circumstance-specific discriminator; and (b) training the circumstance-specific object detector, the circumstance-specific deconvolutional layer, the circumstance-specific convolutional layer, and the circumstance-specific discriminator.

Learning method and learning device for updating object detector, based on deep learning, of autonomous vehicle to adapt the object detector to driving circumstance, and updating method and updating device using the same

A method for training a perception network includes (a) perceiving first image-level data obtained from a first imaging device through the perception network to generate first prediction results, and training the perception network based on the first prediction results, (b) augmenting the first and second image-level data, respectively obtained from the first and a second imaging device, through a transfer network to generate first and second feature-level data, perceiving the first and the second feature-level data through the perception network to generate second prediction results, and training the transfer network based on the second prediction results, and (c) augmenting the first and the second image-level data through the transfer network to generate third feature-level data, perceiving the third feature-level data through the perception network to generate third prediction results, and retraining the perception network based on the third prediction results.

Methods for training and testing perception network by using images obtained from multiple imaging devices having diverse specifications and learning device and testing device using the same

A method of on-vehicle active learning for training a perception network of an autonomous vehicle is provided. The method includes steps of: an on-vehicle active learning device, (a) if a driving video and sensing information are acquired from a camera and sensors on an autonomous vehicle, inputting frames of the driving video and the sensing information into a scene code assigning module to generate scene codes including information on scenes in the frames and on driving events; and (b) at least one of selecting a part of the frames, whose object detection information satisfies a condition, as specific frames by using the scene codes and the object detection information and selecting a part of the frames, matching a training policy, as the specific frames by using the scene codes and the object detection information, and storing the specific frames and specific scene codes in a frame storing part.

Method and device for on-vehicle active learning to be used for training perception network of autonomous vehicle

A method of self-supervised learning for detection network using deep Q-network includes steps of: performing object detection on first unlabeled image through the detection network trained with training database to generate first object detection information and performing learning operation on a first state set corresponding to the first object detection information to generate a Q-value, if an action of the Q-value accepts the first unlabeled image, testing the detection network, retrained with the training database additionally containing a labeled image of the first unlabeled image, to generate a first accuracy, and if the action rejects the first unlabeled image, testing the detection network without retraining, to generate a second accuracy, and storing the first state set, the action, a reward of the first or the second accuracy, and a second state set of a second unlabeled image as transition vector, and training the deep Q-network by using the transition vector.

Methods for performing self-supervised learning of deep-learning based detection network by using deep Q-network and devices using the same

A method for calibrating a pitch of a camera on a vehicle is provided. The method includes steps of: a calibration device (a) inputting driving images from the camera into an object detection network to detect objects and generate object detection information and into a lane detection network to detect lanes and generate lane detection information; (b) profiling the object and the lane detection information to generate object profiling information and lane profiling information, inputting the object profiling information into an object-based pitch estimation module to select a first target object and a second target object to generate a first pitch and a second pitch, and (iii) inputting vanishing point detection information and the lane profiling information into a lane-based pitch estimation module to generate a third pitch and a fourth pitch; and (c) inputting the first to the fourth pitches into a pitch-deciding module to generate a decided pitch.

Method and device for calibrating pitch of camera on vehicle and method and device for continual learning of vanishing point estimation model to be used for calibrating the pitch

A method for training an object detection network by using attention maps is provided. The method includes steps of: (a) an on-device learning device inputting the training images into a feature extraction network, inputting outputs of the feature extraction network into a attention network and a concatenation layer, and inputting outputs of the attention network into the concatenation layer; (b) the on-device learning device inputting outputs of the concatenation layer into an RPN and an ROI pooling layer, inputting outputs of the RPN into a binary convertor and the ROI pooling layer, and inputting outputs of the ROI pooling layer into a detection network and thus to output object detection data; and (c) the on-device learning device train at least one of the feature extraction network, the detection network, the RPN and the attention network through backpropagations using an object detection losses, an RPN losses, and a cross-entropy losses.

Learning method and learning device for training an object detection network by using attention maps and testing method and testing device using the same

Processes of explainable active learning, for an object detector, by using a Bayesian dual encoder is provided. The processes include: (a) inputting test images into the object detector to generate cropped images, resizing the test images and the cropped images, and inputting the resized images into a data encoder to output data codes; (b) (b1) one of (i) inputting the test images into the object detector, applying Bayesian output embedding and resizing the activation entropy maps and the cropped activation entropy maps, and (ii) inputting resized object images and applying the Bayesian output embedding and (b2) inputting the resized activation entropy maps into a model encoder to output model codes; and (c) (i) confirming reference data codes, selecting specific test images as rare samples, and updating the data codebook, and (ii) confirming reference model codes and selecting specific test images as hard samples.

Method for explainable active learning, to be used for object detector, by using Bayesian dual autoencoder and active learning device using the same

A method for optimizing an on-device neural network model by using a Sub-kernel Searching Module is provided. The method includes steps of a learning device (a) if a Big Neural Network Model having a capacity capable of performing a targeted task by using a maximal computing power of an edge device has been trained to generate a first inference result on an input data, allowing the Sub-kernel Searching Module to identify constraint and a state vector corresponding to the training data, to generate architecture information on a specific sub-kernel suitable for performing the targeted task on the training data, (b) optimizing the Big Neural Network Model according to the architecture information to generate a specific Small Neural Network Model for generating a second inference result on the training data, and (c) training the Sub-kernel Searching Module by using the first and the second inference result.

Method for optimizing on-device neural network model by using sub-kernel searching module and device using the same

A method for training a deep learning network based on artificial intelligence is provided. The method includes steps of: a learning device (a) inputting unlabeled data into an active learning network to acquire sub unlabeled data and inputting the sub unlabeled data into an auto labeling network to generate new labeled data; (b) allowing a continual learning network to sample the new labeled data and existing labeled data to generate a mini-batch, and train the existing learning network using the mini-batch to acquire a trained learning network, wherein part of the mini-batch are selected by referring to specific existing losses; and (c) (i) allowing an explainable analysis network to generate insightful results on validation data and transmit the insightful results to a human engineer to transmit an analysis of the trained learning network and (ii) modifying at least one of the active learning network and the continual learning network.

Method for training deep learning network based on artificial intelligence and learning device using the same

A method for performing continual learning on a classifier, in a client, capable of classifying images by using a continual learning server is provided. The method includes steps of: a continual learning server (a) inputting first hard images from a first classifier of a client into an Adversarial Autoencoder, to allow an encoder to output latent vectors from the first hard images, allow a decoder to output reconstructed images from the latent vectors, and allow a discriminator and a second classifier to output attribute and classification information to determine second hard images to be stored in a first training data set, and generating augmented images to be stored in a second training data set by adjusting the latent vectors of the reconstructed images determined not as the second hard images; (b) continual learning a third classifier corresponding to the first classifier; and (c) transmitting updated parameters to the client.

Method for performing continual learning on classifier in client capable of classifying images by using continual learning server and continual learning server using the same

The present disclosure relates to a face recognition method, an apparatus, and a computer-readable recording medium for executing the method. According to some aspects of the present disclosure, the face recognition method includes: (a) a key point setting step of setting key points at designated positions on an input face image; (b) a key point descriptor extracting step of extracting each descriptor for each key point; and (c) a matching step of determining whether the input face image matches pre-stored face images using descriptors for key points within a designated region including each descriptor for each first key point obtained from the input face image, and second key points of pre-stored face images which correspond to first key points obtained from the input face image.

Growing community of inventors

Pohang-si, South Korea

Bongnam Kang