Amazon Technologies, Inc.

Chuhang Zou

Jayakrishnan Kumar Eledath

Jean Laurent Guigues

Gerard Guy Medioni

Nishitkumar Ashokkumar Desai

Behjat Siddiquie

Petko Tsonev

Claire Law

Chris Broaddus

Paul Ignatius Dizon Echevarria

Matthew Fletcher Harrison

Connor Spencer Blue Worley

Pahal Kamlesh Dalal

Tian Lan

Hui Liang

Abhay Mittal

This disclosure describes techniques for updating planogram data associated with a facility. The planogram may indicate inventory locations within the facility for various types of items supported by product fixtures. In particular an image of a product fixture is analyzed to identify image segments corresponding to product groups, where each product group consists of instances of the same product and each image segment corresponds to a group of image points. Image data is further analyzed to determine coordinates of the points of each image segment. A product space corresponding to the product group is then defined based on the coordinates of the points of the product group. In some cases, for example, a product space may be defined in terms of the coordinates of the corners of a rectangular bounding box or volume.

Image-based detection of planogram product spaces

Cameras having storage fixtures within their fields of view are programmed to capture images and process clips of the images to generate sets of features representing product spaces and actors depicted within such images, and to classify the clips as depicting or not depicting a shopping event. Where consecutive clips are determined to depict a shopping event, features of such clips are combined into a sequence and transferred, along with classifications of the clips and a start time and end time of the shopping event, to a multi-camera system. A shopping hypothesis is generated based on such sequences of features received from cameras, along with information regarding items detected within the hands of such actors, to determine a summary of shopping activity by an actor, and to update a record of items associated with the actor accordingly.

Detecting interactions from features determined from sequences of images captured using one or more cameras

This disclosure describes techniques for determining product volumes associated with products in a facility. These product volumes may be used to update planogram data associated with a facility, with the planogram data indicating inventory locations within the facility for various types of items supported by product fixtures. The planogram data may be used, in some instances, to update virtual carts of users interacting with the items in the facility.

Growing community of inventors

Seattle, WA, United States of America

Chuhang Zou