Carnegie Mellon University

Yutong Zheng

Marios Savvides

Sreena Nallamothu

Uzair Ahmed

Chenchen Zhu

Ran Tao

Dipan Kumar Pal

Khoa Luu

Magesh Kannan

Yu Kai Huang

Kai Hu

Ahmed Uzair

A method of training a deep neural network, such as would be used in facial recognition, includes training the deep neural network to normalize feature vectors to a learned value representing the radius of a multi-dimensional hypersphere using a convex augmentation of the primary loss function.

Convex feature normalization for face recognition

Disclosed herein is a method to disentangle linear-encoded facial semantics from facial images without external supervision. The method uses linear regression and sparse representation learning concepts to make the disentangled latent representations easily interpreted and manipulated. Generated facial images are decomposed into multiple semantic features and latent representations are extracted to capture interpretable facial semantics. The semantic features may be manipulated to synthesize photorealistic facial images by sampling along vectors representing the semantic features, thereby changing the associate semantics.

System and method for photorealistic image synthesis using unsupervised semantic feature disentanglement

Disclosed herein is a system and method of identifying misplaced products on a retail shelf using a feature extractor trained to extract features from images of products on the shelf and output identifying information regarding the product in the product image. The extracted features are compared to extracted features in a product library and a best fit is obtained. A misplaced product is identified if the identifying information produced by the feature extractor fails to match the identifying information associated with the best fit features from the product library.

System and method for identifying misplaced products in a shelf management system

Disclosed herein is a system and method for augmenting data by generating a plurality of pose-altered images of an item from one or more 2D images of the item and using the augmented data to train a train a feature extractor. In other aspects of the invention, the trained feature extractor is used to enroll features extracted from images of new products in a library database of known products or to identify images of unknown products by matching features of an image of the unknown product with features stored in the library database.

System and method for pose tolerant feature extraction using generated pose-altered images

Methods of detecting an object in an image using a convolutional neural network based architecture that processes multiple feature maps of differing scales from differing convolution layers within a convolutional network to create a regional-proposal bounding box. The bounding box is projected back to the feature maps of the individual convolution layers to obtain a set of regions of interest. These regions of interest are then processed to ultimately create a confidence score representing the confidence that the object detected in the bounding box is the desired object. These processes allow the method to utilize deep features encoded in both the global and the local representation for object regions, allowing the method to robustly deal with challenges in the problem of robust object detection. Software for executing the disclosed methods within an object-detection system is also disclosed.

Growing community of inventors

Pittsburgh, PA, United States of America

Yutong Zheng