International Business Machines Corporation

Toshiba Global Commerce Solutions Holdings Corporation

Toshiba Global Commerce

Solutions Holdings Corporation

Akira Yanagawa

Sharathchandra UmapathiRao Pankanti

Yun Zhai

Russell Patrick Bobbitt

Arun Hampapur

Quanfu Fan

Frederik C Kjeldsen

Myron Dale Flickner

Hiroki Nakano

Charles A Otto

Masahiko Kitagawa

Unsang Park

Frederik C M Kjeldsen

Techniques for detecting one or more events are provided. The techniques include identifying one or more segments in a video sequence as one or more candidates for one or more events by a temporal ordering of the one or more candidates, and analyzing one or more motion patterns of the one or more candidates to detect the one or more events.

Detecting primitive events at checkout

An approach that automatically distinguishes between in-store customers and in-store employees is provided. In one embodiment, there is a learning tool configured to construct a model for an in-store employee; a matching tool configured to match attributes between a particular person and the constructed models for an in-store employee; and a classifying tool configured to classify persons into categories of employees and customers based on amount of matching attributes between a particular person and the model for an in-store employee.

System and method for automatically distinguishing between customers and in-store employees

Techniques for detecting one or more events are provided. The techniques include using multiple overlapping regions of interest on a video sequence to cover a location for one or more events, wherein each event is associated with at least one of the multiple overlapping regions of interest, applying multiple-instance learning to the video sequence to select one or more of the multiple overlapping regions of interest to construct one or more location-aware event models, and applying the models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events.

Location-aware event detection

Techniques for creating a training technique for an individual are provided. The techniques include obtaining video of one or more events and information from a transaction log that corresponds to the one or more events, wherein the one or more events relate to one or more actions of an individual, classifying the one or more events into one or more event categories, comparing the one or more classified events with an enterprise best practices model to determine a degree of compliance, examining the one or more classified events to correct one or more misclassifications, if any, and revise the one or more event categories with the one or more corrected misclassifications, if any, and using the degree of compliance to create a training technique for the individual.

Creating a training tool

An approach that dynamically learns a set of attributes of an operator of a point of sale (POS) is provided. In one embodiment, there is an attribute tool, including an extraction component configured to receive sensor data of a set of moving objects, and extract a set of attributes from each of the set of moving objects captured within the scan area at the POS; an identification component configured to update an appearance model with the set of attributes from each of the set of moving objects; and an analysis component configured to analyze the appearance model to identify at least one of the set of moving objects as an operator of the POS.

Dynamically learning attributes of a point of sale operator

Techniques for generating an alert based on absence of a given person in a transaction are provided. The techniques include monitoring, via video, a transaction, wherein the transaction includes presence of a given person in the transaction, relating the video of the transaction to a corresponding portion of a transaction log (TLOG), using the video and corresponding portion of the TLOG to detect if the given person in the transaction is present, and generating an alert if the given person is not present at the transaction.

Generating an alert based on absence of a given person in a transaction

Techniques for automatically calibrating one or more regions of interest for video surveillance are provided. The techniques include at a user-defined frequency, determining if one or more regions of interest (ROIs) are present within a field of view of a camera, if one or more ROIs are present within the field of view of the camera, automatically calibrating the one or more ROIs within the field of view of the camera, and if one or more ROIs are not present within the field of view of the camera, sending an alert to a user.

Automatically calibrating regions of interest for video surveillance

Techniques for detecting one or more events are provided. The techniques include using one or more regions of interest on a video sequence to cover a location for one or more events, wherein each event is associated with at least one of the one or more regions of interest, applying multiple-instance learning to the video sequence to construct one or more location-aware event models, and applying the models to the video sequence to determine the one or more regions of interest that are associated with the one or more events.

Techniques for analyzing one or more sequential events performed by a human actor to evaluate efficiency of the human actor are provided. The techniques include identifying one or more segments in a video sequence as one or more components of one or more sequential events performed by a human actor, integrating the one or more components into one or more sequential events by incorporating a spatiotemporal model and one or more event detectors, and analyzing the one or more sequential events to analyze behavior of the human actor.

Analyzing repetitive sequential events

Techniques for using transactional and visual event information to facilitate loss prevention are provided. The techniques include obtaining video of one or more visual events at a point of sale environment and one or more transaction log entries that correspond to the video, wherein the one or more transaction log entries comprise one or more transactional events, categorizing each event as one of one or more model events, using each categorized event to create a revised transaction log, wherein the revised transaction log comprises a sequence of categorized events, wherein each categorized event is a combination of the one or more transactional events and the one or more visual events, examining the revised transaction log to correct one or more mis-categorizations, if any, and revise one or more model event categories with the one or more corrected mis-categorizations, if any, and using the revised transaction log to facilitate loss prevention.

Using detailed process information at a point of sale

A non-scan detect system for a retail checkout station includes a non-scan detect module. The non-scan detect module, when operated, causes the non-scan detect system to detect the passing of an item across a scanner device of a retail checkout station, determine that the item passing across the scanner device was not registered as a scan, establish a potential non-scanned item based on the item not being registered as a scan, obtain an image of the potential non-scanned item, establish a scanned item based on an item passing across the scanner device being registered as a scan, extract features associated with the scanned item, compare the features associated with the scanned item with the image of the potential non-scanned item, and trigger an actual non-scan if the features of the scanned item do not substantially match the image of the potential non-scanned item.

Non-scan detect system for a retail checkout station

A method for detecting a non-scan at a retail checkout station includes detecting the passing of an item across a scanner device of a retail checkout station, obtaining an image of the item passing across the scanner, detecting a scan of an item passing across the scanner to establish a scanned item, and establishing a register associated with the scanned item. A scan occurs if the image of the item passing across the scanner substantially matches the register associated with the scanned item. Conversely, a non-scan is triggered when the image of the item passing across the scanner does not match the register associated with the scanned item.

Method for detecting a non-scan at a retail checkout station

An image processing system comprises a plurality of memories to which image data is input, a control circuit for selecting areas for image processing from the image data input to the memories, and a plurality of DSPs connected to the memories and performing image processing of the selected image data selected by the control circuit. The present invention provides a an image processing system and method where selected image data including overlap areas can be sent from memories to DSPs by entering the same image data into a plurality of memories, without requiring transfers of overlap areas between DSPs, such that the image processing speed is improved.

Image processing system and method

Provided are an image processing method employing pattern matching, whereby the number of calculations for a normalized correlation factor can be reduced and processing speed can be increased in a pattern matching process, and an image processing system therefor. In the pattern matching processing when an insensitive region is set in a template image, values (the sum and the squared sum) obtained during a previous operation for a prior search target sub-image are employed to perform calculations for a current search target sub-image, relative to coordinate sequence code that indicates the start point and the end point of a sequence of pixels having values of '1.'

Growing community of inventors

New York, NY, United States of America

Akira Yanagawa