Gatekeeper Systems, Inc.

Narayanan V Ramanathan

Scott J Carter

Stephen E Hannah

Jesse Michael James

Jack Johnson

Robert M Harling

Ryan M Morrison

Ho Man M Fong

A system for monitoring shopping carts uses cameras to generate images of the carts moving in a store. In some implementations, cameras may additionally or alternatively be mounted to the shopping carts and configured to image cart contents. The system may use the collected image data, and/or other types of sensor data (such as the store location at which an item was added to the basket), to classify items detected in the shopping carts. For example, a trained machine learning model may classify item in a cart as 'non-merchandise,' “high theft risk merchandise,” “electronics merchandise,” etc. When a shopping cart approaches a store exit without any indication of an associated payment transaction, the system may use the associated item classification data, optionally in combination with other data such as cart path data, to determine whether to execute an anti-theft action, such as locking a cart wheel or activating a store alarm. The system may also compare the classifications of cart contents to payment transaction records (or summaries thereof) to, e.g., detect underpayment events.

Shopping basket monitoring using computer vision

Examples of systems and methods for locating movable objects such as carts (e.g., shopping carts) are disclosed. Such systems and methods can use dead reckoning techniques to estimate the current position of the movable object. Various techniques for improving accuracy of position estimates are disclosed, including compensation for various error sources involving the use of magnetometer and accelerometer, and using vibration analysis to derive wheel rotation rates. Also disclosed are various techniques to utilize characteristics of the operating environment in conjunction with or in lieu of dead reckoning techniques, including characteristic of environment such as ground texture, availability of signals from radio frequency (RF) transmitters including precision fix sources. Such systems and methods can be applied in both indoor and outdoor settings and in retail or warehouse settings.

Estimating motion of wheeled carts

A system for monitoring shopping baskets (e.g., baskets on human-propelled carts, motorized carts, or hand-carried baskets) can include a computer vision unit that can image a surveillance region (e.g., an exit to a store), determine whether a basket is empty or loaded with merchandise, and assess a potential for theft of the merchandise. The computer vision unit can include a camera and an image processor programmed to execute a computer vision algorithm to identify shopping baskets and determine a load status of the basket. The computer vision algorithm can comprise a neural network. The system can identify an at least partially loaded shopping basket that is exiting the store, without indicia of having paid for the merchandise, and execute an anti-theft action, e.g., actuating an alarm, notifying store personnel, activating a store surveillance system, activating an anti-theft device associated with the basket (e.g., a locking shopping cart wheel), etc.

Shopping basket monitoring using computer vision and machine learning

Examples of systems and methods for calibrating or operating a magnetic sensor for sensor temperature or operating conditions are provided. The magnetic sensor can comprise a dual magnetometer sensor that comprises a first, low-power-consumption magnetometer (e.g., a magneto-inductive magnetometer) and a second higher-power-consumption magnetometer (e.g., a magneto-resistive magnetometer). The second magnetometer can have a lower unit-to-unit variation in temperature calibration parameters and can be used to temperature-correct readings from the first magnetometer. The magnetic sensor can dynamically switch between usage of the first magnetometer and the second magnetometer in order to provide a dynamic sample rate that can depend on conditions within the sensor or external to the sensor.

Dual magnetometer calibration

Examples of systems and methods for locating movable objects such as carts (e.g., shopping carts) are disclosed. Such systems and methods can use dead reckoning techniques to estimate the current position of the movable object. Various techniques for improving accuracy of position estimates are disclosed, including compensation for various error sources involving the use of magnetometer and accelerometer, and using vibration analysis to derive wheel rotation rates. Various techniques utilize characteristics of the operating environment in conjunction with or in lieu of dead reckoning techniques, including characteristic of environment such as ground texture, availability of signals from radio frequency (RF) transmitters including precision fix sources. Navigation techniques can include navigation history and backtracking, motion direction detection for dual swivel casters, use of gyroscopes, determining cart weight, multi-level navigation, multi-level magnetic measurements, use of lighting signatures, use of multiple navigation systems, or hard/soft iron compensation for different cart configurations.

Anti-theft system that uses shopping cart location and vibration data

A system for monitoring shopping carts uses cameras to generate images of the carts moving in a store. In some implementations, cameras may additionally or alternatively be mounted to the shopping carts and configured to image cart contents. The system may use the collected image data, and/or other types of sensor data (such as the store location at which an item was added to the basket), to classify items detected in the shopping carts. For example, a trained machine learning model may classify item in a cart as 'non-merchandise,' 'high theft risk merchandise,' &#x201c;electronics merchandise,&#x201d; etc. When a shopping cart approaches a store exit without any indication of an associated payment transaction, the system may use the associated item classification data, optionally in combination with other data such as cart path data, to determine whether to execute an anti-theft action, such as locking a cart wheel or activating a store alarm. The system may also compare the classifications of cart contents to payment transaction records (or summaries thereof) to, e.g., detect underpayment events.

Growing community of inventors

Lake Forest, CA, United States of America

Narayanan V Ramanathan