Panasonic Corporation

Matsushita Electric Industrial Co., Ltd.

Kuo Chu Lee

Hasan Timucin Ozdemir

Juan Yu

Lipin Liu

Hongbing Li

Namsoo Joo

Shuji Inoue

Shaomin Samuel Mo

Shiwen Chen

Eimei Nanma

Sameer Kibey

Supraja Mosali

Tao Lin

A method is provided for detecting a threat in a distributed multi-camera surveillance system. The method includes: monitoring movement of an object in a field of view of a first camera using software installed at the first camera; detecting a suspicious object at the first camera when movement of the object does not conform with a motion flow model residing at the first camera; sending a tracking request from the first camera to a second camera upon detecting the suspicious object at the first camera; monitoring movement of the object in a field of view of the second camera using software installed at the second camera; assigning threat scores at the second camera when the movement of the object does not conform with a motion flow model residing at the second camera; and generating an alarm based in part on the threat scores detected at the first camera and the second camera.

Threat-detection in a distributed multi-camera surveillance system

A system and method for predictive abnormal behavior detection is disclosed. The system receives surveillance data such as video data and can create and update a plurality of prediction models. The system may also receive video data relating to a moving object and may generate a prediction of the future locations of the moving object based on the generated prediction models. The predicted motion may be scored by a scoring engine to determine if the predicted motion is unsafe or otherwise undesirable.

Predicting a future location of a moving object observed by a surveillance device

A multi-perspective context sensitive behavior assessment system includes an adaptive behavior model builder establishing a real-time reference model that captures intention of motion behavior. It operates by modeling outputs of multiple user defined scoring functions with respect to multiple references of application specific target areas of interest. The target areas have criticality values representing a user's preference regarding the target areas with respect to one another. The outputs of the scoring functions are multiplied by the critically values to form high level sequences of representation that are communicated to the user.

System architecture and process for assessing multi-perspective multi-context abnormal behavior

A surveillance system implements an architecture and process to support real-time abnormal behavior assessment operations in a distributed scalable sensor network. An automated behavior model builder generates behavior models from sensor data. A plurality of abnormal behavior scoring engines operating concurrently to generate abnormal behavior assessment models by scoring the behavior models. An execution performance manager performs fast switching of behavior models for the abnormal behavior scoring engines. The execution performance manager performs detection of abnormal behavior score distribution characteristic deviation by comparing a current abnormal behavior assessment model to a pre-recorded abnormal behavior assessment model. The execution performance manager selects a pre-recorded behavior model for the abnormal behavior scoring engines when the deviation exceeds a predetermined threshold.

System architecture and process for seamless adaptation to context aware behavior models

The intelligent, automated surveillance system collects the interactions between the security personal and the surveillance system during the handling of an alarm. Each alarm is modeled as a 'transaction' and each operation/action that a security personal executes modeled as an 'event' within the transaction. The collected events within the transaction are in partial order. Furthermore, the system provides a scoring system for a security manager to evaluate the performance of the security guard. The score of the sequence of actions that the security guard performed manually and the system performed automatically for each set of dependent alarms are used to decide future sequence of operation. Security guards can overwrite the automatic sequencing of actions with manual sequence of operations.

System architecture and process for automating intelligent surveillance center operations

A surveillance system generally includes a data capture module that collects sensor data. A scoring engine module receives the sensor data and computes at least one of an abnormality score and a normalcy score based on the sensor data, at least one dynamically loaded learned data model, and a learned scoring method. A decision making module receives the at least one of the abnormality score and the normalcy score and generates an alert message based on the at least one of the abnormality score and the normalcy score and a learned decision making method to produce progressive behavior and threat detection.

Method and system for scoring surveillance system footage

A resource manager transforms the MPEG7 descriptors into an active and composite storage, processing, and presentation component in a storage area network (e.g. iSCSI). The active component can enable fast search and retrival operation directly on the logical disk blocks which maps well with the multimedia video stream and images data. It can also support content addressable search on the video and image files and play the media blocks directly. In addition, it enables a dynamic configuration of a media processing function after it is loaded in an execution environment. The data block is moved from the iSCSI interface directly into processing modules and presentation modules via decoder, buffer, and constraint control units.

Intelligent MPEG media storage, execution, and presentation system using network storage system

A metadata database adaptor for use with a surveillance and/or sensor system is capable of adapting metadata messages of varying formats according to needs of metadata databases. In other aspects, a metadata data model template can allow a user to define a data definition that is used to map user defined data with the metadata data model template to form XML data schema. Template mapping knowledge can then be applied for fast XML data schema to non-XML database schema generation without translation processing. In yet other aspects, an application domain template can allow a user to define a query definition that can then be processed with a mapping of the application domain template to translate Xpath, Xquery, or others to a database query.

System and method for high performance template driven metadata schema mapping and data storage for surveillance and sensor devices

An associative vector storage system has an encoding engine that takes input vectors, and generates transformed coefficients for a tunable number of iterations. Each iteration performs a complete transformation to obtain coefficients, thus performing a process of iterative transformations. The encoding engine selects a subset of coefficients from the coefficients generated by the process of iterative transformations to form an approximation vector with reduced dimension. A data store stores the approximation vectors with a corresponding set of meta data containing information about how the approximation vectors are generated. The meta data includes one or more of the number of iterations, a projection map, quantization, and statistical information associated with each approximation vector. A search engine uses a comparator module to perform similarity search between the approximation vectors and a query vector in a transformed domain. The search engine uses the meta data in a distance calculation of the similarity search.

Associative vector storage system supporting fast similarity search based on self-similarity feature extractions across multiple transformed domains

A meta data management system for use with a surveillance system includes a user interface that allows users to define rules to manage meta data from distributed devices. An application programming interface provides an application access to system data and control information. A mechanism allows the application to transparently and seamlessly integrate with different types of databases by transparently allocating and searching the data that are physically distributed at different devices.

Distributed meta data management middleware

A resource manager allocates operation requests to security network devices according to device characteristics. The devices collect and/or manage data from an environment. The devices may include a camera, a multimedia recorder, an analyzer, and a meta-data server. One or more users submit operation requests to a controller. The controller allocates the network devices to the operation requests according to the device characteristics. The device characteristics include availability of the device, media flow data of the device, location of the device, and capabilities of the device.

Dynamic resource management for distributed retrieval system for security

A peer-to-peer camera sensor network is defined using intelligent cameras that employ iSCSI initiators and iSCSI targets to read and write data and to send control commands directly across the network as iSCSI blocks. Because data transfer rides on top of the internet protocol, cameras can be directly attached to the internet without requiring attachment to a host computer. Image data represented as video frames are mapped onto iSCSI data blocks and are shared among the cameras directly to form an efficient virtual block level video image frame storage that can be directly manipulated by multiple cameras without data replications. Transport of multiple streams, associated with scalable or multilevel MPEG encoding scheme for instance, are automatically sequenced and realigned as the iSCSI data blocks are time-aligned.

Secure and private ISCSI camera network

Distributed modules in a network dynamically select communication protocols to communicate in a secure or firewall-protected network. Applications register with a lookup service. The lookup service maintains a lookup table including registration information for multiple applications. Registration information may include, but is not limited to, IP address, firewall restrictions, tunnel protocol, port information, and proxy queue capabilities. An application seeking to communicate acquires the registration information for a desired recipient from the lookup table. The application uses the registration information to select communication protocols necessary to communicate with the recipient.

Method for dynamic selection for secure and firewall friendly communication protocols between multiple distributed modules

The Web customer contact system is based on distributed execution of service logic programs that can be dynamically altered based on changing business needs. The distributed and dynamic program modification makes the Web customer contact system scalable and customization to the most demanding business operation needs. For example, existing workflow based GUI programming tool, which only support centralized specification, down load and execution of routing rules for incoming calls in a contact center. The new system WCC system can allow user to specify a set of service logic program (SLP) can be dynamically attached to any distributed 'addressable entities' in the WCC system. The addressable entities can be a user, an agent, an email box, a work group, IVR system, or a department web site. The addressable entities can be located anywhere that can be reached by internet address (an URL or other types of identities). The SLP associated with the addressable entities can be dynamically downloaded from the 'home' location of the SLP. The SLP allows a business to define the way of handling customer's messages such as call, chat and email in a flexible and programmable way using an open specification interface such as, XML technology.

Web-content aware automatic call transfer system and process for mobile users and operators

A system and method provides protocol independent communication between mobile electronic devices. Multiple users may communicate using different applications running on different mobile electronic devices with different end-to-end protocols. A multimedia controller in connection with control agents provides the information to establish communications between mobile electronic devices having applications with incompatible communication protocols. A session and routing controller controls communication sessions and a Web hyperlink dictionary provides information regarding the location of the multimedia controller and control agents.

Growing community of inventors

Princeton Junction, NJ, United States of America

Kuo Chu Lee