Videomining Corporation

Jeff Hershey

Rajeev Sharma

Satish Mummareddy

Namsoon Jung

Hankyu Moon

Richard Hirata

Krishna Botla

Varij Saurabh

Priya Baboo

Akhil Kamat

Chris Ahlers

The present invention is a method and system for measuring viewership of people for a displayed object. The displayed object can be specific in-store marketing elements, such as static signage, POP displays, and other forms of digital media, including retail TV networks and kiosks. In the present invention, the viewership comprises impression level, impression count of the viewers, such as how many people actually viewed said displayed object, average length of impression, distribution of impressions by time of day, and rating of media effectiveness based on audience response. The viewership of people is performed automatically based on the 3-dimensional face pose estimation of the people, using a plurality of means for capturing images and a plurality of computer vision technologies on the captured visual information. The present invention distinguishes viewers from passers-by among the plurality of persons in the vicinity of the displayed object, by counting the number of viewers who actually viewed the displayed object vs. passers-by who may appear in the vicinity of the displayed object but do not actually view the displayed object, using the 3-dimensional face pose estimation and a novel usage of a plurality of computer vision technologies.

Method and system for measuring viewership of people for displayed object

A method and system for analyzing product strength or brand strength by determining shopper decision behavior during a shopping trip. Specifically, shopper behavior can be analyzed to determine whether a shopper's decision to purchase an item occurred at-shelf or pre-shelf. Aggregating decision data across many shoppers over time can then be used to generate analytics regarding the strength of a product or brand. The analysis can then be used to make recommendations to manufacturers or retailers about how to strengthen the product or brand. A deployment of cameras and mobile signal sensors can be utilized to recognize shoppers and track their behavior. Demographics information can also be estimated about the tracked shoppers. The visual and mobile signal trajectories can be fused to form a single shopper trajectory, then associated with Point of Sale (PoS) data. This results in a dataset describing the shopping trip for each tracked shopper.

At-shelf brand strength tracking and decision analytics

A method and system for analyzing shopper switching behavior over multiple shopping trips. Specifically, shopper behavior can be analyzed to generate a shopper behavior profile. Aggregating profile data across many shopping trips over time can then be used to generate analytics regarding the shopper's behavior regarding switching between products or brands and whether the shopper's purchase decisions occurred at-shelf or pre-shelf. Further, the data can be aggregated across many shoppers The analysis can then be used to make recommendations to manufacturers or retailers about how to influence shoppers to switch to a brand from a competitor, or to prevent a shopper from switching to a competitor. A deployment of cameras and mobile signal sensors can be utilized to recognize shoppers and track their behavior. Demographics information can also be estimated about the tracked shoppers. The visual and mobile signal trajectories can be fused to form a single shopper trajectory, then associated with Point of Sale (PoS) data. This results in a dataset describing the shopping trip for each tracked shopper.

Brand-switching analysis using longitudinal tracking of at-shelf shopper behavior

The present invention is a method and system for forecasting the demographic characterization of customers to help customize programming contents on each means for playing output of each site of a plurality of sites in a media network through automatically measuring, characterizing, and estimating the demographic information of customers that appear in the vicinity of each means for playing output. The analysis of demographic information of customers is performed automatically based on the visual information of the customers, using a plurality of means for capturing images and a plurality of computer vision technologies on the visual information. The measurement of the demographic information is performed in each measured node, where the node is defined as means for playing output. Extrapolation of the measurement characterizes the demographic information per each node of a plurality of nodes in a site of a plurality of sites of a media network. The forecasting and customization of the programming contents is based on the characterization of the demographic information.

Method and system for automatically measuring and forecasting the demographic characterization of customers to help customize programming contents in a media network

The present invention is a method and system for producing a set of ratings for out-of-home media based on the measurement of behavior patterns and demographics of the people in a digital media network. The present invention captures a plurality of input images of the people in the vicinity of sampled out-of-home media in a digital media network by a plurality of means for capturing images, and tracks each person. The present invention processes the plurality of input images in order to analyze the behavior and demographics of the people. The present invention aggregates the measurements for the behavior patterns and demographics of the people, analyzes the data, and extracts characteristic information based on the estimated parameters from the aggregated measurements. Finally, the present invention calculates a set of ratings based on the characteristic information. The plurality of computer vision technologies can comprise face detection, person tracking, body parts detection, and demographic classification of the people, on the captured visual information of the people in the vicinity of the out-of-home media.

Method and system for rating of out-of-home digital media network based on automatic measurement

The present invention is a method and system for analyzing shopping behavior by associating RFID data, such as tracking data by the RFID tag identifications, with video-based behavior and segmentation data, such as behavior analysis and demographic composition analysis of the customers, utilizing a plurality of means for sensing and using RFID tags, a plurality of means for capturing images, and a plurality of computer vision technologies. In the present invention, the association can further comprise the association of the RFID with the transaction data or any time-based measurement in the retail space. The analyzed shopping behavior in the present invention helps people to better understand business elements in a retail space. It is one of the objectives of the present invention to provide an automatic video-based segmentation of customers in the association with the RFID based tracking of the customers, based on a novel usage of a plurality of means for capturing images and a plurality of computer vision technologies on the captured visual information of the people in the retail space. The plurality of computer vision technologies can comprise face detection, person tracking, body parts detection, and demographic classification of the people, on the captured visual information of the people in the retail space.

Method and system for analyzing shopping behavior in a store by associating RFID data with video-based behavior and segmentation data

The present invention is a method and system for segmenting a plurality of persons in a physical space based on automatic behavior analysis of the persons in a preferred embodiment. The behavior analysis can comprise a path analysis as one of the characterization methods. The present invention applies segmentation criteria to the output of the video-based behavior analysis and assigns segmentation label to each of the persons during a predefined window of time. In addition to the behavioral characteristics, the present invention can also utilize other types of visual characterization, such as demographic analysis, or additional input sources, such as sales data, to segment the plurality of persons in another exemplary embodiment. The present invention captures a plurality of input images of the persons in the physical space by a plurality of means for capturing images. The present invention processes the plurality of input images in order to understand the behavioral characteristics, such as shopping behavior, of the persons for the segmentation purpose. The processes are based on a novel usage of a plurality of computer vision technologies to analyze the visual characterization of the persons from the plurality of input images. The physical space may be a retail space, and the persons may be customers in the retail space.

Method and system for segmenting people in a physical space based on automatic behavior analysis

The present invention is a method and system for automatically analyzing a category in a plurality of the categories in a physical space based on the visual characterization, such as behavior analysis or segmentation, of the persons with regard to the category. The present invention captures a plurality of input images of the persons in the category by a plurality of means for capturing images. The present invention processes the plurality of input images in order to understand the shopping behavior of the persons with the sub-categories of the category and analyzes the level of engagement and decision process at the sub-category level. The processes are based on a novel usage of a plurality of computer vision technologies to analyze the visual characterization of the persons from the plurality of input images. The physical space may be a retail space, and the persons may be customers in the retail space.

Method and system for automatically analyzing categories in a physical space based on the visual characterization of people

The present invention is a method and system for characterizing physical space based on automatic demographics measurement, using a plurality of means for capturing images and a plurality of computer vision technologies. The present invention is called demographic-based retail space characterization (DBR). Although the disclosed method is described in the context of retail space, the present invention can be applied to any physical space that has a restricted boundary. In the present invention, the physical space characterization can comprise various types of characterization depending on the objective of the physical space, and it is one of the objectives of the present invention to provide the automatic demographic composition measurement to facilitate the physical space characterization. The demographic classification and composition measurement of people in the physical space is performed automatically based on a novel usage of a plurality of means for capturing images and a plurality of computer vision technologies on the captured visual information of the people in the physical space. The plurality of computer vision technologies can comprise face detection, person tracking, body parts detection, and demographic classification of the people, on the captured visual information of the people in the physical space.

Method and system for characterizing physical retail spaces by determining the demographic composition of people in the physical retail spaces utilizing video image analysis

The present invention is a method and system for forecasting the behavioral characterization of customers to help customize programming contents on each means for playing output of each site of a plurality of sites in a media network through automatically measuring, characterizing, and forecasting the behavioral information of customers that appear in the vicinity of each means for playing output. The analysis of behavioral information of customers is performed automatically based on the visual information of the customers, using a plurality of means for capturing images and a plurality of computer vision technologies on the visual information. The measurement of the behavioral information is performed in each measured node, where the node is defined as means for playing output. Extrapolation of the measurement characterizes the behavioral information per each node of a plurality of nodes in a site of a plurality of sites of a media network. The forecasting and customization of the programming contents is based on the characterization of the behavioral information.

Method and system for automatically measuring and forecasting the behavioral characterization of customers to help customize programming contents in a media network

The present invention is a method and system for recognizing employees among the people in a physical space based on automatic behavior analysis of the people in a preferred embodiment. The present invention captures a plurality of input images of the people in the physical space by a plurality of means for capturing images. The present invention processes the plurality of input images in order to understand the behavioral characteristics of the people for the employee recognition purpose. The behavior analysis can comprise a path analysis as one of the characterization methods. The path analysis collects a plurality of trip information for each tracked person during a predefined window of time. The trip information can comprise spatial and temporal attributes, such as coordinates of the person's position, trip time, trip length, and average velocity for each of the plurality of trips. Based on the employee recognition criteria applied to the trip information, the present invention distinguishes employees from non-employees during a predefined window of time. The processes are based on a novel usage of a plurality of computer vision technologies to analyze the behavior of the people from the plurality of input images.

Method and system for recognizing employees in a physical space based on automatic behavior analysis

The present invention is a method and system for automatically changing the advertisement contents on a means for displaying the contents based on a customer's behavior or a group of customers' behavior in a retail store. The analysis of behavioral pattern is performed automatically and in real-time based on the visual information from the shopping and walkthrough history of a customer or a group of customers, using arrays of sensing devices, such as a plurality of means for capturing images, and a plurality of computer vision technologies on the visual information.

Growing community of inventors

Norfolk, VA, United States of America

Jeff Hershey