Hrl Laboratories, LLC

Gm Global Technolgoy Operations, Inc.

The Boeing Company

Xlabs Holdings, LLC

Swarup S Medasani

Yuri Owechko

Narayan Srinivasa

Kyungnam Kim

Yang Chen

Shinko Yuanhsien Cheng

David L Allen

Thommen Korah

Deepak Khosla

Tsai-Ching Lu

Qin Jiang

Riccardo Boscolo

Dmitriy V Korchev

Payam Saisan

Jose M Molineros

James W Wells

Suhas E Chelian

Jiejun Xu

Leandro G Barajas

Rashmi N Sundareswara

Ronald Tadao Azuma

Jim Nelson

Rahul Shringarpure

David W Payton

Yilu Zhang

Roland J Menassa

Michael J Daily

Charles W Wampler, Ii

Shankar R Rao

Dejan Nikic

Ryan M Uhlenbrock

Nick S Kapsokavathis

Howard Neely, Iii

Jason Meltzer

Zhichao Chen

Alexander Krayner

Jason Wu

Michael Cao

José M Molineros

A method is disclosed. The method receives a two dimensional or a three dimensional computer generated representation of an area, receives a plurality of images of the area captured by one or more video cameras, detects a first moving object in the plurality of images, generates a computer representation of the first moving object, correlates the images of the area captured by the one or more video cameras with the two dimensional or three dimensional computer generated representation of the area, and displays the computer representation of the first moving object in the two dimensional or the three dimensional computer generated representation of the area.

Contextual visual dataspaces

A method for localizing and estimating a pose of a known object in a field of view of a vision system is described, and includes developing a processor-based model of the known object, capturing a bitmap image file including an image of the field of view including the known object, extracting features from the bitmap image file, matching the extracted features with features associated with the model of the known object, localizing an object in the bitmap image file based upon the extracted features, clustering the extracted features of the localized object, merging the clustered extracted features, detecting the known object in the field of view based upon a comparison of the merged clustered extracted features and the processor-based model of the known object, and estimating a pose of the detected known object in the field of view based upon the detecting of the known object.

Method for object localization and pose estimation for an object of interest

Described is a system for dynamic background estimation which utilizes Particle Swarm Optimization (PSO). The present invention comprises a system, method, and computer program product for accurate estimation of a background mask corresponding to a dynamically changing scene. The system is configured to construct a background template model of a scene, and then capture an image of a current view of the scene with a camera. Thereafter, the system generates an image-based template matching cost function as an optimization problem, where the objective is to identify and fit a corresponding subregion of the background template model to the current camera view. The cost function is optimized using a PSO search algorithm. Finally, the system is configured to generate the corresponding subregion of the background template model for display. The inherent efficiency of PSO makes this system conducive for use in applications requiring real-time background estimation.

Dynamic background estimation for video analysis using evolutionary optimization

The present invention relates to a classifier cascade object detection system. The system operates by inputting an image patch into parallel feature generation modules, each of the feature generation modules operable for extracting features from the image patch. The features are provided to an opportunistic classifier cascade, the opportunistic classifier cascade having a series of classifier stages. The opportunistic classifier cascade is executed by progressively evaluating, in each classifier in the classifier cascade, the features to produce a response, with each response progressively utilized by a decision function to generate a stage response for each classifier stage. If each stage response exceeds a stage threshold then the image patch is classified as a target object, and if the stage response from any of the decision functions does not exceed the stage threshold, then the image patch is classified as a non-target object.

Opportunistic cascade and cascade training, evaluation, and execution for vision-based object detection

A method and system for video-content based retrieval is described. A query video depicting an activity is processed using interest point selection to find locations in the video that are relevant to that activity. A set of spatio-temporal descriptors such as self-similarity and 3-D SIFT are calculated within a local neighborhood of the set of interest points. An indexed video database containing videos similar to the query video is searched using the set of descriptors to obtain a set of candidate videos. The videos in the video database are indexed hierarchically using a vocabulary tree or other hierarchical indexing mechanism.

Video content-based retrieval

A human monitoring system includes a plurality of cameras and a visual processor. The plurality of cameras are disposed about a workspace area, where each camera is configured to capture a video feed that includes a plurality of image frames, and the plurality of image frames are time-synchronized between the respective cameras. The visual processor is configured to receive the plurality of image frames from the plurality of vision-based imaging devices and determine an integrity score for each respective image frame. The processor may then isolate a foreground section from two or more of the views, determine a principle body axis for each respective foreground section, and determine a location point according to a weighted least squares function amongst the various principle body axes.

Vision-based multi-camera factory monitoring with dynamic integrity scoring

Described is a method and system for embedding unsupervised learning into three critical processing stages of the spatio-temporal visual stream. The system first receives input video comprising input video pixels representing at least one action and at least one object having a location. Microactions are generated from the input image using a set of motion sensitive filters. A relationship between the input video pixels and the microactions is then learned, and a set of spatio-temporal concepts is learned from the microactions. The system then learns to acquire new knowledge from the spatio-temporal concepts using mental imagery processes. Finally, a visual output is presented to a user based on the learned set of spatio-temporal concepts and the new knowledge to aid the user in visually comprehending the at least one action in the input video.

Method and system for embedding visual intelligence

A method and apparatus for identifying a target object. A group of objects is identified in an image. The group of objects provides a context for identifying the target object in the image. The target object is searched for in the image using the context provided by the group of objects.

Context-based target recognition

A method, system, and computer program product for detecting objects. Members of a general class of objects are searched for in a number of images. Members of a specific class of objects are searched for in a number of regions in the number of images where the number of regions contains at least a portion of the members of the general class. A member in the members of the specific class is a potential threat to a rotorcraft.

Rotorcraft threat detection system

Described is a system for object and behavior recognition which utilizes a collection of modules which, when integrated, can automatically recognize, learn, and adapt to simple and complex visual behaviors. An object recognition module utilizes a cooperative swarm algorithm to classify an object in a domain. A graph-based object representation module is configured to use a graphical model to represent a spatial organization of the object within the domain. Additionally, a reasoning and recognition engine module consists of two sub-modules: a knowledge sub-module and a behavior recognition sub-module. The knowledge sub-module utilizes a Bayesian network, while the behavior recognition sub-module consists of layers of adaptive resonance theory clustering networks and a layer of a sustained temporal order recurrent temporal order network. The described invention has applications in video forensics, data mining, and intelligent video archiving.

Method for online learning and recognition of visual behaviors

The present invention relates to an object detection and behavior recognition system using three-dimensional motion data. The system receives three-dimensional (3D) motion data of a scene from at least one sensor, such as a LIDAR sensor. An object is identified in the 3D motion data. Thereafter, an object track is extracted, the object track being indicative of object motion in the scene over time. Through Dynamic Time Warping (DTW) or other comparison techniques, the object track is compared to a database to identify the behavior of the object based on its object track.

Three-dimensional (3D) object detection and multi-agent behavior recognition using 3D motion data

A method and apparatus for processing images. A sequence of images for a scene is received from an imaging system. An object in the scene is detected using the sequence of images. A viewpoint of the imaging system is registered to a model of the scene using a region in the model of the scene in which an expected behavior of the object is expected to occur.

Multi-modal sensor fusion

Described is a system for content recognition, search, and retrieval in visual data. The system is configured to perform operations of receiving visual data as an input, processing the visual data, and extracting distinct activity-agnostic content descriptors from the visual data at each level of a hierarchical content descriptor module. The resulting content descriptors are then indexed with a hierarchical content indexing module, wherein each level of the content indexing module comprises a distinct set of indexed content descriptors. The visual data, generated content descriptors, and indexed content descriptors are then stored in a storage module. Finally, based on a content-based query by a user, the storage module is searched, and visual data containing the content of interest is retrieved and presented to the user. A method and computer program product for content recognition, search, and retrieval in visual data are also described.

Hierarchical video search and recognition system

Described is a system for registering a viewpoint of an imaging sensor with respect to a geospatial model or map. An image of a scene of a geospatial region comprising an object is received as input. The image of the scene is captured by a sensor having a current sensor state. Observation data related to the object's state is received, wherein the observation data comprises an object behavior of the object given the geospatial region. An estimate of the current sensor state is generated using a probability of an observation from the observation data given the current sensor state x. Finally, the image of the scene is registered with a geospatial model or map based on the estimate of the current sensor state.

Contextual behavior state filter for sensor registration

Described is a system and method for detecting elevated structures, such as bridges and overpasses, in point cloud data. A set of data from a three-dimensional point cloud of a landscape is received by the system. The set of data points comprises inlier data points and outlier data points. The inlier data points in the three-dimensional point cloud data are identified and combined into at least one segment. The segment is converted into an image comprising at least one image level. Each image level is processed with an edge detection algorithm to detect elevated edges. The elevated edges are vectorized to identify an elevated structure of interest in the landscape. The present invention is useful in applications that require three-dimensional sensing systems, such as autonomous navigation and surveillance applications.

Growing community of inventors

Newbury Park, CA, United States of America

Swarup S Medasani