International Business Machines Corporation

Gaurav Goswami

Nalini Kanta Ratha

Sharathchandra UmapathiRao Pankanti

Sharathchandra Umapathirao Pankanti

Richa Singh

Mayank Vatsa

An entity learning recognition method, system, and computer program product include learning (i.e., in a training phase) from at least one entity to produce augments entities such that an augmented entity is still recognizable as the original entity but differs sufficiently to produce a different feature representation of the entity to create a database for use (i.e., in an implementation phase).

Entity learning recognition

An entity learning recognition method and computer program product include learning training a model based on a combination of an original entity and an augmented entity in an augmented database, where the entity includes an image that is used for a training of the model and where the training is based on a visual element portion of the image with added noise.

A neural network is configured to suppress an output of a mitigation node in a mitigation layer of the neural network. The neural network is pre-configured to recognize objects from inputs when operating using a processor and a memory. An actual input is sent to the neural network for object recognition, the actual input is an altered input. By suppressing the output of the mitigation node, the neural network is caused to avoid falsely recognizing an object from the actual input, where the altered input is configured to cause the neural network to falsely recognize the object from the actual input.

Mitigating false recognition of altered inputs in convolutional neural networks

Mechanisms are provided to provide an improved computer tool for determining and mitigating the presence of adversarial inputs to an image classification computing model. A machine learning computer model processes input data representing a first image to generate a first classification output. A cohort of second image(s), that are visually similar to the first image, is generated based on a comparison of visual characteristics of the first image to visual characteristics of images in an image repository. A cohort-based machine learning computer model processes the cohort of second image(s) to generate a second classification output and the first classification output is compared to the second classification output to determine if the first image is an adversarial image. In response to the first image being determined to be an adversarial image, a mitigation operation by a mitigation system is initiated.

Cohort based adversarial attack detection

Multiple trained AI models are tested using known genuine samples of respective multiple modalities of multimedia to generate versions of the multiple modalities of a given multimedia sample. Data for the multimedia and the multimedia sample are divided into the multiple modalities. Respective differences are computed between respective components of the multiple trained AI models to produce respective multiple difference vector, which are compared with corresponding baseline difference vectors determined in order to train the multiple trained AI models. The given multimedia sample is classified as genuine or altered using at least the comparison.

Detecting artificial multimedia content using deep network response analysis

A system, method and program product for implementing image recognition. A system is disclosed that includes a training system for generating a multi-feature multi-matcher fusion (MMF) predictor for scoring pairs of images, the training system having: a neural network configurable to extract a set of feature spaces at different resolutions based on a training dataset; and an optimizer that processes the training dataset, extracted feature spaces and a set of matcher functions to generate the MMF predictor having a series of weighted feature/matcher components; and a prediction system that utilizes the MMF predictor to generate a prediction score indicative of a match for a pair of images.

Multi-level deep feature and multi-matcher fusion for improved image recognition

Mechanisms are provided for training a classifier to identify adversarial input data. A neural network processes original input data representing a plurality of non-adversarial original input data and mean output learning logic determines a mean response for each intermediate layer of the neural network based on results of processing the original input data. The neural network processes adversarial input data and layer-wise comparison logic compares, for each intermediate layer of the neural network, a response generated by the intermediate layer based on processing the adversarial input data, to the mean response associated with the intermediate layer, to thereby generate a distance metric for the intermediate layer. The layer-wise comparison logic generates a vector output based on the distance metrics that is used to train a classifier to identify adversarial input data based on responses generated by intermediate layers of the neural network.

Growing community of inventors

Bengaluru, India

Gaurav Goswami