Sarnoff Corporation

Sri International

L-3 Communications Corporation

Eyelock LLC

Mamigo Inc

Manoj Aggarwal

Keith James Hanna

Harpreet Singh Sawhney

Rakesh Kumar

Supun Samarasekera

Tao Zhao

Aydin Arpa

Vincent Paragano

David Kalokitis

David R Patterson

Changjiang Yang

David Nister

Peter Jeffrey Burt

Stephen Charles Hsu

Subhodev Das

Jayan Eledath

Philip Miller

Sarvesh Makthal

Thomas Germano

Mikhail Teverovskiy

Supun Samarasakera

Deepak Sethi

Vince Paragano

The present disclosure describes systems and methods for authorization. The method may include accessing, by an authorization engine for a transaction by a user, an activity pattern model of the user from a database. The activity pattern model of the user may be indicative of a geospatial behavior of the user over time. The authorization engine may determine a set of sensors available for facilitating the transaction, each of the sensors assigned with a usability value prior to the transaction. The authorization engine may access an activity pattern model of the sensors, the activity pattern model of the sensors indicative of geospatial characteristics of one or more of the sensors over time. The authorization engine may determine a convenience metric for each of a plurality of subsets of the sensors, using the activity pattern model of the user, the activity pattern model of the sensors, and usability values of corresponding sensors. Each of the plurality of subsets may include corresponding sensors that can be used in combination to facilitate the transaction. The authorization engine may select, using the determined convenience metrics, a subset from the plurality of subsets to use for the transaction.

Model-based prediction of an optimal convenience metric for authorizing transactions

A scalable method and apparatus is described to provide personalized interactive visualization of a plurality of compressed image data to a plurality of concurrent users. A plurality of image sources are digitally processed in the compressed domain to provide controllable enhanced user-specific interactive visualization with support for adjustment in viewing parameters such frame-rate, field of view, resolution, color format, viewpoint and bandwidth.

Method and system for scalable multi-user interactive visualization

The present invention provides a system and method for detecting and tracking a moving object. First, robust change detection is applied to find initial candidate regions in consecutive frames. These initial detections in consecutive frames are stacked to produce space-time bands which are extracted by Hough transform and entropy minimization based band detection algorithm.

System and method for detecting and tracking an object of interest in spatio-temporal space

A system for tracking at least one object is disclosed. The system includes a plurality of communicatively connected visual sensing units configured to capture visual data related to the at least one object The system also includes a manager component communicatively connected to the plurality of visual sensing units. The manager component is configured to assign one visual sensing unit to act as a visual sensing unit in a master mode and at least one visual sensing unit to act as a visual sensing unit in a slave mode. The manager component is further configured to transmit at least one control signal to the plurality of visual sensing units, and receive the visual data from the plurality of visual sensing units.

Method and apparatus for performing coordinated multi-PTZ camera tracking

A sentient system combines detection, tracking, and immersive visualization of a cluttered and crowded environment, such as an office building, terminal, or other enclosed site using a network of stereo cameras. A guard monitors the site using a live 3D model, which is updated from different directions using the multiple video streams. As a person moves within the view of a camera, the system detects its motion and tracks the person's path, it hands off the track to the next camera when the person goes out of that camera's view. Multiple people can be tracked simultaneously both within and across cameras, with each track shown on a map display. The track system includes a track map browser that displays the tracks of all moving objects as well as a history of recent tracks and a video flashlight viewer that displays live immersive video of any person that is being tracked.

Method and apparatus for total situational awareness and monitoring

According to an aspect of the invention, a system for providing immersive surveillance a site has a plurality of cameras each producing a respective raw video of a respective portion of the site. A processing component receives the raw video from the cameras and generates processed video from it. A visualization engine is coupled to the processing system, and receives the processed video therefrom. The visualization engine renders real-time images corresponding to a view of the site in which at least a portion of the processed video is overlaid onto a rendering of an image based on a computer model of the site. The visualization engine displays the images in real time to a viewer. The processing component comprises first and second filter modules. The second filter module processes video received as output from the first filter module. A controller component controls all transmission of data and video between the first and second filter modules.

Modular immersive surveillance processing system and method

A unified approach, a fusion technique, a space-time constraint, a methodology, and system architecture are provided. The unified approach is to fuse the outputs of monocular and stereo video trackers, RFID and localization systems and biometric identification systems. The fusion technique is provided that is based on the transformation of the sensory information from heterogeneous sources into a common coordinate system with rigorous uncertainties analysis to account for various sensor noises and ambiguities. The space-time constraint is used to fuse different sensor using the location and velocity information. Advantages include the ability to continuously track multiple humans with their identities in a large area. The methodology is general so that other sensors can be incorporated into the system. The system architecture is provided for the underlying real-time processing of the sensors.

Method and apparatus for stereo, multi-camera tracking and RF and video track fusion

A method and apparatus for detecting suspicious activities is disclosed. In one embodiment at least one low-level feature set is detected in a plurality of frames of a sequence of scene imagery. The frame-to-frame associations of the detected low-level feature set are determined, and suspicious activities is identifying on the bases of these frame-to-frame associations.

Method and apparatus for detecting suspicious activities

Method for tracking an object recorded within a selected frame of a sequence of frames of video data, using a plurality of layers, where at least one object layer of the plurality of layers represents the object includes initializing layer ownership probabilities for pixels of the selected frame using a non-parametric motion model, estimating a set of motion parameters of the plurality of layers for the selected frame using a parametric maximization algorithm and tracking the object. The non-parametric motion model is optical flow and includes warping the mixing probabilities, the appearances of the plurality of layers, and the observed pixel data from the pixels of the preceding frame to the pixels of the selected frame to initialize the layer ownership probabilities for the pixels of the selected frame.

Flexible layer tracking with weak online appearance model

A method and apparatus for video surveillance is disclosed. In one embodiment, a sequence of scene imagery representing a field of view is received. One or more moving objects are identified within the sequence of scene imagery and then classified in accordance with one or more extracted spatio-temporal features. This classification may then be applied to determine whether the moving object and/or its behavior fits one or more known events or behaviors that are causes for alarm.

Method and apparatus for improved video surveillance through classification of detected objects

A scalable architecture for providing real-time multi-camera distributed video processing and visualization. An exemplary system comprises at least one video capture and storage system for capturing and storing a plurality of input videos, at least one vision based alarm system for detecting and reporting alarm situations or events, and at least one video rendering system (e.g., a video flashlight system) for displaying an alarm situation in a context that speeds up comprehension and response. One advantage of the present architecture is that these systems are all scalable, such that additional sensors (e.g., cameras, motion sensors, infrared sensors, chemical sensors, biological sensors, temperature sensors and like) can be added in large numbers without overwhelming the ability of security forces to comprehend the alarm situation.

Method and apparatus for providing a scalable multi-camera distributed video processing and visualization surveillance system

A method and/or system for tracking objects, such as humans, over a wide area (that is, over an area that is delineated by a large spatial domain and/or a long-duration temporal domain) is provided. Such tracking is facilitated by processing, in real-time, near real-time or otherwise contemporaneous with receiving, images captured by each of a plurality or network of slightly overlapping stereo sensors, such as stereo cameras. The method includes and the apparatus is adapted for obtaining a plurality of local-track segments, wherein the plurality of local-track segments correspond to an object captured in images taken by a respective plurality of stereo sensors; and combining the local-track segments to form a global track.

Method and apparatus for tracking objects over a wide area using a network of stereo sensors

A method and apparatus for providing immersive surveillance wherein a remote security guard may monitor a scene using a variety of imagery sources that are rendered upon a model to provide a three-dimensional conceptual view of the scene. Using a view selector, the security guard may dynamically select a camera view to be displayed on his conceptual model, perform a walk through of the scene, identify moving objects and select the best view of those moving objects and so on.

Method and apparatus for providing immersive surveillance

A method and system for detecting moving objects and controlling a surveillance system includes a processing module adapted to receive image information from at least one imaging sensor. The system performs motion detection analysis upon captured images and controls the camera in a specific manner upon detection of a moving object. The image processing uses the camera's physical orientation to a surveillance area to facilitate mapping images captured by the camera to a reference map of the surveillance area. Using the camera orientation, a moving object's position (e.g., latitude, longitude and altitude) within a scene can be derived.

Growing community of inventors

Lawrenceville, NJ, United States of America

Manoj Aggarwal