International Business Machines Corporation

Lisa Marie Brown

Arun Hampapur

Rogerio Schmidt Feris

Andrew William Senior

Ying-Li Tian

Sharathchandra UmapathiRao Pankanti

Daniel Andre Vaquero

Yun Zhai

Longbin Chen

Chiao-Fe Shu

Senem Velipasalar

Jonathan Hudson Connell, Ii

Zuoxuan Lu

Nalini Kanta Ratha

Rudolf Maarten Bolle

Susan Crayne

Raymond A Cooke

Daniel André Vaquero

Ying Li Tian

Generating visual data by defining a first action into a first set of objects and corresponding first set of motions, and defining a second action into a second set of objects and corresponding second set of motions. A relationship is then determined for the second action to the first action in terms of relationships between corresponding constituent objects and motions. Objects and motions are detected from visual data of first action. Visual data is composed for the second action from the data by transforming the constituent objects and motions detected in first action based on the corresponding determined relationships.

Augmentation for visual action data

A data indexing system and method includes acquiring activity data in a context and indexing the activity data in accordance with contextual conditions. The activity data is stored in accordance with indices. An event is correlated with the activity data by using the indices to review the activity data in the context.

People searches by multisensor event correlation

Methods, systems, and computer program products for parsing objects are provided herein. A method includes producing a plurality of versions of an image of an object derived from an input, wherein each version comprises one of one multiple resolutions of said image of said object; computing an appearance probability at each of a plurality of regions on the one or more lowest resolution versions of said plurality of versions of said image for at least one attribute for said object; determining a configuration of the at least one attribute in the one or more lowest resolution versions based on at least the appearance probability in each of the plurality of regions; and outputting said configuration.

Semantic parsing of objects in video

A system comprises an input component, a feature extractor, an object classifier, an adaptation component and a calibration tool. The input component is configured to receive one or more images, and the feature extractor is configured to extract features for one or more objects in the one or more images, the extracted features comprising at least one view-independent feature. The object classifier is configured to classify the one or more objects based at least in part on the extracted features and one or more object classification parameters, and the adaptation component is configured to adjust the classification of at least one of the objects based on one or more contextual parameters. The calibration tool is configured to adjust one or more of the object classification parameters based on likelihoods for characteristics associated with one or more object classes.

Video object classification

Techniques, systems, and articles of manufacture for multispectral detection of attributes for video surveillance. A method includes generating one or more training sets of one or more multispectral images, generating a group of one or more multispectral box features, using the one or more training sets to select one or more of the one or more multispectral box features to generate a multispectral attribute detector, and using the multispectral attribute detector to identify a location of an attribute in video surveillance, wherein using the multispectral attribute detector comprises, for one or more locations on each spectral band level of the multispectral image, applying the multispectral attribute detector and producing an output indicating attribute detection or an output indicating no attribute detection, and wherein the attribute corresponds to the multispectral attribute detector.

Multispectral detection of personal attributes for video surveillance

Methods, systems, and computer program products for parsing objects in a video are provided herein. A method includes producing a plurality of versions of an image of an object derived from a video input, wherein each version has a different resolution of said image of said object; computing an appearance score at each of a plurality of regions on the lowest resolution version of said plurality of versions of said image for at least one attribute for said object, wherein said appearance score denotes a probability of the at least one attribute appearing in the region; determining a configuration of the at least one attribute in the lowest resolution version based on at least the appearance score in each of the plurality of regions in the lowest resolution version; and displaying said configuration.

Methods, systems, and computer program products for parsing objects in a video are provided herein. A method includes producing a plurality of versions of an image of an object, wherein each version has a different resolution of said image of said object, and computing an appearance score at each of a plurality of regions on the lowest resolution version for at least one attribute for said object. Such a method also includes analyzing one or more other versions to compute a resolution context score for each of the plurality of regions in the lowest resolution version, and determining a configuration of the at least one semantic attribute in the lowest resolution version based on the appearance score and the resolution context score.

Techniques for calibrating a classification system, wherein one or more objects in at least one video are classified, are provided. At least one view associated with the at least one video is obtained. The at least one view is partitioned into at least one region. A given object is classified in accordance with its location in reference to the at least one region. In an additional embodiment, one or more object models are obtained. At least one normalized size of the one or more objects is defined within at least one view associated with the at least one video in accordance with the one or more object models. The one or more objects are classified in accordance with the at least one defined normalized size.

Calibration of video object classification

Methods, systems, and computer program products for parsing objects in a video are provided herein. A method includes producing a plurality of versions of an image of an object, wherein each version has a different resolution of said image of said object, and computing an appearance score at each of a plurality of regions on the lowest resolution version for at least one semantic attribute for said object. Such a method also includes analyzing one or more other versions to compute a resolution context score for each of the plurality of regions in the lowest resolution version, wherein said resolution context score denotes an extent to which finer spatial structure exists in the one or more others versions than in the lowest resolution version, and determining a configuration of the at least one semantic attribute in the lowest resolution version based on the appearance score and the resolution context score.

Techniques, systems, and computer program products for parsing objects in a video are provided herein. A method includes producing and storing a plurality of versions of an image of an object derived from a video input, wherein each version of said image has a different resolution of said image; computing an appearance score at each of a plurality of regions on the lowest resolution version of said image for a plurality of semantic attributes with associated parts for said object, said appearance score denoting a probability of each semantic attribute appearing in the region; analyzing increasingly higher resolution versions than the lowest resolution version to compute a resolution context score for each region in the lowest resolution version; and ascertaining an optimized configuration of body parts and associated semantic attributes in the lowest resolution version, said ascertaining utilizing the appearance scores and the resolution context scores.

The invention provides an improved method to detect semantic attributes of human body in computer vision. In detecting semantic attributes of human body in computer vision, the invention maintains a list of semantic attributes, each of which corresponds to a human body part. A computer module then analyzes segments of a frame of a digital video to detect each semantic attribute by finding a most likely attribute for each segment. A threshold is applied to select candidate segments of the frame for further analysis. The candidate segments of the frame then go through geometric and resolution context analysis by applying the physical structure principles of a human body and by analyzing increasingly higher resolution versions of the image to verify the existence and accuracy of parts and attributes. A computer module computes a resolution context score for a lower resolution version of the image based on a weighted average score computed for a higher resolution version of the image by evaluating appearance features, geometric features, and resolution context features when available on the higher resolution version of the image. Finally, an optimal configuration step is performed via dynamic programming to select an optimal output with both semantic attributes and spatial positions of human body parts on the frame.

Techniques for classifying one or more objects in at least one video, wherein the at least one video comprises a plurality of frames are provided. One or more objects in the plurality of frames are tracked. A level of deformation is computed for each of the one or more tracked objects in accordance with at least one change in a plurality of histograms of oriented gradients for a corresponding tracked object. Each of the one or more tracked objects is classified in accordance with the computed level of deformation.

A system for automatically acquiring high-resolution images by steering a pan-tilt-zoom camera at targets detected in a fixed camera view is provided. The system uses automatic or manual calibration between multiple cameras. Using automatic calibration, the homography between the cameras in a home position is estimated together with the effects of pan and tilt controls and the expected height of a person in the image. These calibrations are chained together to steer a slave camera. The manual calibration scheme steers a camera to the desired region of interest and calculates the pan, tile and zoom parameters accordingly.

Growing community of inventors

Pleasantville, NY, United States of America

Lisa Marie Brown