Lawrence Livermore National Security, LLC

Peer-Timo Bremer

Jayaraman Jayaraman Thiagarajan

Rushil Anirudh

Hyojin Kim

Bhavya Kailkhura

A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a feature vector comprising a universal image representation of the target image that is derived from the generated latent variables of the subgraphs to generate a classification for the target image.

Universal image representation based on a multimodal graph

Methods and systems are provided to generate an uncorrupted version of an image given an observed image that is a corrupted version of the image. In some embodiments, a corruption mimicking ('CM') system iteratively trains a corruption mimicking network ('CMN') to generate corrupted images given modeled images, updates latent vectors based on differences between the corrupted images and observed images, and applies a generator to the latent vectors to generate modeled images. The training, updating, and applying are performed until modeled images that are input to the CMN result in corrupted images that approximate the observed images. Because the CMN is trained to mimic the corruption of the observed images, the final modeled images represented the uncorrupted version of the observed images.

Mimicking of corruption in images

A system for identifying in an image an object that is commonly found in a collection of images and for identifying a portion of an image that represents an object based on a consensus analysis of segmentations of the image. The system collects images of containers that contain objects for generating a collection of common objects within the containers. To process the images, the system generates a segmentation of each image. The image analysis system may also generate multiple segmentations for each image by introducing variations in the selection of voxels to be merged into a segment. The system then generates clusters of the segments based on similarity among the segments. Each cluster represents a common object found in the containers. Once the clustering is complete, the system may be used to identify common objects in images of new containers based on similarity between segments of images and the clusters.

Identification of uncommon objects in containers

A system for identifying objects in an image is provided. The system identifies segments of an image that may contain objects. For each segment, the system generates a segment score by inputting to a multi-scale neural network windows of multiple scales that include the segment that have been resampled to a fixed window size. A multi-scale neural network includes a feature extracting convolutional neural network ('feCNN') for each scale and a classifier that inputs each feature of each feCNN. The segment score indicates whether the segment contains an object. The system generates a pixel score for pixels of the image. The pixel score for a pixel indicates that that pixel is within an object based on the segment scores of segments that contain that pixel. The system then identifies the object based on the pixel scores of neighboring pixels.

Growing community of inventors

Livermore, CA, United States of America

Peer-Timo Bremer