Panasonic Corporation

Matsushita Electric Industrial Co., Ltd.

Hasan Timucin Ozdemir

Kuo Chu Lee

Lipin Liu

Juan Yu

Hongbing Li

Namsoo Joo

K C Lee

Shuji Inoue

Shiwen Chen

Eimei Nanma

Sameer Kibey

Supraja Mosali

A method is provided for detecting a threat in a distributed multi-camera surveillance system. The method includes: monitoring movement of an object in a field of view of a first camera using software installed at the first camera; detecting a suspicious object at the first camera when movement of the object does not conform with a motion flow model residing at the first camera; sending a tracking request from the first camera to a second camera upon detecting the suspicious object at the first camera; monitoring movement of the object in a field of view of the second camera using software installed at the second camera; assigning threat scores at the second camera when the movement of the object does not conform with a motion flow model residing at the second camera; and generating an alarm based in part on the threat scores detected at the first camera and the second camera.

Threat-detection in a distributed multi-camera surveillance system

A system and method for predictive abnormal behavior detection is disclosed. The system receives surveillance data such as video data and can create and update a plurality of prediction models. The system may also receive video data relating to a moving object and may generate a prediction of the future locations of the moving object based on the generated prediction models. The predicted motion may be scored by a scoring engine to determine if the predicted motion is unsafe or otherwise undesirable.

Predicting a future location of a moving object observed by a surveillance device

A multi-perspective context sensitive behavior assessment system includes an adaptive behavior model builder establishing a real-time reference model that captures intention of motion behavior. It operates by modeling outputs of multiple user defined scoring functions with respect to multiple references of application specific target areas of interest. The target areas have criticality values representing a user's preference regarding the target areas with respect to one another. The outputs of the scoring functions are multiplied by the critically values to form high level sequences of representation that are communicated to the user.

System architecture and process for assessing multi-perspective multi-context abnormal behavior

A surveillance system implements an architecture and process to support real-time abnormal behavior assessment operations in a distributed scalable sensor network. An automated behavior model builder generates behavior models from sensor data. A plurality of abnormal behavior scoring engines operating concurrently to generate abnormal behavior assessment models by scoring the behavior models. An execution performance manager performs fast switching of behavior models for the abnormal behavior scoring engines. The execution performance manager performs detection of abnormal behavior score distribution characteristic deviation by comparing a current abnormal behavior assessment model to a pre-recorded abnormal behavior assessment model. The execution performance manager selects a pre-recorded behavior model for the abnormal behavior scoring engines when the deviation exceeds a predetermined threshold.

System architecture and process for seamless adaptation to context aware behavior models

The intelligent, automated surveillance system collects the interactions between the security personal and the surveillance system during the handling of an alarm. Each alarm is modeled as a 'transaction' and each operation/action that a security personal executes modeled as an 'event' within the transaction. The collected events within the transaction are in partial order. Furthermore, the system provides a scoring system for a security manager to evaluate the performance of the security guard. The score of the sequence of actions that the security guard performed manually and the system performed automatically for each set of dependent alarms are used to decide future sequence of operation. Security guards can overwrite the automatic sequencing of actions with manual sequence of operations.

System architecture and process for automating intelligent surveillance center operations

An Intelligent, dynamic, long-term digital Surveillance Media storage System (ISMS), proposes an intelligent, dynamic, digital media storage mechanism for digital surveillance applications that can analyze media streams in real-time and provide flexible, scalable, and self-adjustable encoding and indexing mechanisms based on actual needs for digital surveillance systems. The system includes several subsystems, such as: (1) a media stream retriever/receiver; (2) a content-based description generator; (3) an intelligent engine with metadata description storage and media file storage (4) an event manager; (5) a media stream writer; and (6) an encoding optimizer.

Intelligent, dynamic, long-term digital surveilance media storage system

A surveillance system generally includes a data capture module that collects sensor data. A scoring engine module receives the sensor data and computes at least one of an abnormality score and a normalcy score based on the sensor data, at least one dynamically loaded learned data model, and a learned scoring method. A decision making module receives the at least one of the abnormality score and the normalcy score and generates an alert message based on the at least one of the abnormality score and the normalcy score and a learned decision making method to produce progressive behavior and threat detection.

Method and system for scoring surveillance system footage

A resource manager transforms the MPEG7 descriptors into an active and composite storage, processing, and presentation component in a storage area network (e.g. iSCSI). The active component can enable fast search and retrival operation directly on the logical disk blocks which maps well with the multimedia video stream and images data. It can also support content addressable search on the video and image files and play the media blocks directly. In addition, it enables a dynamic configuration of a media processing function after it is loaded in an execution environment. The data block is moved from the iSCSI interface directly into processing modules and presentation modules via decoder, buffer, and constraint control units.

Intelligent MPEG media storage, execution, and presentation system using network storage system

An associative vector storage system has an encoding engine that takes input vectors, and generates transformed coefficients for a tunable number of iterations. Each iteration performs a complete transformation to obtain coefficients, thus performing a process of iterative transformations. The encoding engine selects a subset of coefficients from the coefficients generated by the process of iterative transformations to form an approximation vector with reduced dimension. A data store stores the approximation vectors with a corresponding set of meta data containing information about how the approximation vectors are generated. The meta data includes one or more of the number of iterations, a projection map, quantization, and statistical information associated with each approximation vector. A search engine uses a comparator module to perform similarity search between the approximation vectors and a query vector in a transformed domain. The search engine uses the meta data in a distance calculation of the similarity search.

Associative vector storage system supporting fast similarity search based on self-similarity feature extractions across multiple transformed domains

The originator requests information from a target by launching a receptor agent that propagates across the mobile ad hoc network to the target. Along the way, intermediate nodes retain copies of the receptor. The target adds reply information to the receptor and launches it onto the network. When the reply-bearing receptor rendezvous with a receptor copies that contain matching patterns corresponding to the reply-bearing receptor, the reply information is transferred to those receptor copies. The information transferred may be encrypted at the target, using encryption key supplied by the originator. In this way, intermediate nodes cannot access the information being propagated in the receptors that they host.

Content based secure rendezvous chaotic routing system for ultra high speed mobile communications in ad hoc network environment

A meta data management system for use with a surveillance system includes a user interface that allows users to define rules to manage meta data from distributed devices. An application programming interface provides an application access to system data and control information. A mechanism allows the application to transparently and seamlessly integrate with different types of databases by transparently allocating and searching the data that are physically distributed at different devices.

Distributed meta data management middleware

A resource manager allocates operation requests to security network devices according to device characteristics. The devices collect and/or manage data from an environment. The devices may include a camera, a multimedia recorder, an analyzer, and a meta-data server. One or more users submit operation requests to a controller. The controller allocates the network devices to the operation requests according to the device characteristics. The device characteristics include availability of the device, media flow data of the device, location of the device, and capabilities of the device.

Dynamic resource management for distributed retrieval system for security

A peer-to-peer camera sensor network is defined using intelligent cameras that employ iSCSI initiators and iSCSI targets to read and write data and to send control commands directly across the network as iSCSI blocks. Because data transfer rides on top of the internet protocol, cameras can be directly attached to the internet without requiring attachment to a host computer. Image data represented as video frames are mapped onto iSCSI data blocks and are shared among the cameras directly to form an efficient virtual block level video image frame storage that can be directly manipulated by multiple cameras without data replications. Transport of multiple streams, associated with scalable or multilevel MPEG encoding scheme for instance, are automatically sequenced and realigned as the iSCSI data blocks are time-aligned.

Secure and private ISCSI camera network

Distributed modules in a network dynamically select communication protocols to communicate in a secure or firewall-protected network. Applications register with a lookup service. The lookup service maintains a lookup table including registration information for multiple applications. Registration information may include, but is not limited to, IP address, firewall restrictions, tunnel protocol, port information, and proxy queue capabilities. An application seeking to communicate acquires the registration information for a desired recipient from the lookup table. The application uses the registration information to select communication protocols necessary to communicate with the recipient.

Method for dynamic selection for secure and firewall friendly communication protocols between multiple distributed modules

A system and method provides protocol independent communication between mobile electronic devices. Multiple users may communicate using different applications running on different mobile electronic devices with different end-to-end protocols. A multimedia controller in connection with control agents provides the information to establish communications between mobile electronic devices having applications with incompatible communication protocols. A session and routing controller controls communication sessions and a Web hyperlink dictionary provides information regarding the location of the multimedia controller and control agents.

Growing community of inventors

Plainsboro, NJ, United States of America

Hasan Timucin Ozdemir