International Business Machines Corporation

Globalfoundries Inc.

Zuoxuan Lu

Arun Hampapur

Chiao-Fe Shu

Christopher Scott Milite

Stephen R Russo

Chek Keong Tan

Michael J Desimone

Carl P Mercier

Ying-Li Tian

Quanfu Fan

Sharathchandra UmapathiRao Pankanti

Rogerio Schmidt Feris

Sachiko Miyazawa

Andrew William Senior

Lisa Marie Brown

Sharathchandra U Pankanti, I

Yun Zhai

Russell Patrick Bobbitt

Lisa Maire Brown

Frederik C M Kjeldsen

Raymond A Cooke

Jiyan Pan

A data indexing system and method includes acquiring activity data in a context and indexing the activity data in accordance with contextual conditions. The activity data is stored in accordance with indices. An event is correlated with the activity data by using the indices to review the activity data in the context.

People searches by multisensor event correlation

An approach for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of a trajectory of an object for an event within video image data; generate a lossless compressed contour-coded blob to encode the trajectory data of the trajectory of the object for the event within video image data; generate a lossy searchable code of the trajectory of the object for the event within the video image data; convert a region of interest within the video image data to a lossy query code, the region of interest corresponding to a sub-section of a visual display output of the video image data; and compare the lossy query code to the lossy searchable code within a relational database to identify a corresponding lossless trajectory data of the trajectory of the object for the event within the video image data.

Coding scheme for identifying spatial locations of events within video image data

Software for static object detection that performs the following operations: (i) detecting an object that is present in at least one image of a set of images, wherein the set of images correspond to a time period; (ii) identifying a set of corner points for the detected object; (iii) tracking the object's presence in the set of images over the time period, wherein the object's presence is determined by matching the set of images to a template generated based on the identified corner points; and (iv) identifying the object as a static object when an amount of time corresponding to the object's presence in the set of images is greater than a predefined threshold.

Long-term static object detection

An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for detecting an object and obtaining trajectory data of a trajectory of the object within the video image data from a sensor device; converting the trajectory data into a contour-coded compressed image; generating, based on the trajectory data, a searchable code that contains a set of locations traversed by the trajectory of the object within the video image; associating the searchable code with the contour-coded compressed image in a database; and returning, in response to a query having a selected location that corresponds a location of the set of locations in the searchable code, an image of the trajectory data corresponding to the object based on the contour-coded compressed image in the database.

Identifying spatial locations of events within video image data

Video analytics data is audited through review of selective subsets of visual images from a visual image stream as a function of a temporal relationship of the images to a triggering alert event. The subset comprehends an image contemporaneous with the triggering alert event and one or more other images occurring before or after the contemporaneous image. The generated subset may be presented for review to determine whether the triggering alert event is a true or false alert, or whether additional data from the visual image stream is required to make such a determination. If determined from the presented visual essence that the additional data is required to make the true or false determination, then additional data is presented from the visual image stream for review.

Auditing video analytics through essence generation

An approach that indexes and searches according to a set of attributes of a person is provided. In one embodiment, there is an extensible indexing and search tool, including an extraction component configured to extract a set of attributes of a person monitored by a set of sensors in a zone of interest. An index component is configured to index each of the set of attributes of the person within an index of an extensible indexing and search tool. A search component is configured to enable a search of the index of the extensible indexing and search tool according to at least one of the set of attributes of the person.

Indexing and searching according to attributes of a person

An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising: identifying one or more pixel regions from the plurality of pixel regions containing trajectory data; performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and generating a transition chain code based on the multi-point neighborhood scan. Embodiments further generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code, and generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

A method and system for real time processing of a sequence of video frames. A current frame in the sequence and at least one frame in the sequence occurring prior to the current frame is analyzed. Each frame includes a two-dimensional array of pixels. The sequence of video frames is received in synchronization with a recording of the video frames in real time. The analyzing includes performing a background subtraction on the at least one frame, which determines a background image and a static region mask associated with a static region consisting of a contiguous distribution of pixels in the current frame. The static region mask identifies each pixel in the static region upon the static region mask being superimposed on the current frame. The background image includes the array of pixels and a background model of the at least one frame and does not include any moving object.

Real time processing of video frames for triggering an alert

Video analytics data is audited through review of selective subsets of visual images from a visual image stream as a function of a temporal relationship of the images to a triggering alert event. The subset comprehends an image contemporaneous with the triggering alert event and one or more other images occurring before or after the contemporaneous image. The generated subset may be presented for review to determine whether the triggering alert event is a true or false alert, or whether additional data from the visual image stream is required to make such a determination. If determined from the presented visual essence that the additional data is required make the true or false determination, then additional data is presented from the visual image stream for review.

A foreground object blob having a bounding box detected in frame image data is classified by a finite state machine as a background, moving foreground, or temporally static object, namely as the temporally static object when the detected bounding box is distinguished from a background model of a scene image of the video data input and remains static in the scene image for a threshold period. The bounding box is tracked through matching masks in subsequent frame data of the video data input, and the object sub-classified within a visible sub-state, an occluded sub-state, or another sub-state that is not visible and not occluded as a function of a static value ratio. The ratio is a number of pixels determined to be static by tracking in a foreground region of the background model corresponding to the tracked object bounding box over a total number of pixels of the foreground region.

Modeling of temporarily static objects in surveillance video data

Video analytics data is audited through review of selective visual essence subsets of visual images from a visual image stream as a function of a temporal relationship of the essence subset images to a triggering alert event. The visual essence subset comprehends an image contemporaneous with the triggering alert event and one or more other images occurring before or after the contemporaneous image. The generated visual essence is presented for review to determine whether the triggering alert event is a true or false alert, or whether additional data from the visual image stream is required to make such a determination. If determined from the presented visual essence that the additional data is required make the true or false determination, then additional data is presented from the visual image stream for review.

An invention for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, generate a lossless compressed contour-coded blob to encode the trajectory data of the event within video image data, and generate a lossy searchable code to enable searching of a relational database based on the trajectory data of the event within the video image data.

Growing community of inventors

Yorktown Heights, NY, United States of America

Zuoxuan Lu