Amazon Technologies, Inc.

Thomas Meilandt Mathiesen

Jason Michael Famularo

Amber Autrey Taylor

Dilip Kumar

Gianna Lise Puerini

Korwin Jon Smith

Sridhar Boyapati

Alexander Michael McNamara

Jared Joseph Frank

Nishitkumar Ashokkumar Desai

Sudarshan Narasimha Raghavan

Maren Marie Costa

Casey Louis Thurston

Christopher Richard Fescoe

Waqas Syed Ahmed

Danny Guan

Wyatt David Camp

Benjamin Ralph Hollis

Andrew Christopher Chud

Félix Joseph Étienne Pageau

Andrei V Vilkotski

Josiah P Olivieri

Laura A Blanchard

Ata U Bhatti

Described is a system and method for presenting event information to a user and, if necessary, obtaining confirmation of different aspects (user, item, action) of the event. In some implementations, an event includes a user, an action, and an item. For example, an event may include a user picking an item from an inventory location, a user placing an item into a tote associated with the user, etc. If the aspects of the event cannot be determined with a high enough degree of confidence, a user interface may be generated and sent to the user requesting confirmation of one or more of the aspects of the event.

Event determination and presentation

This disclosure describes a system for associating multiple totes with a single profile so that items placed into any of the multiple totes are identified on a profile item identifier list. For example, if two users located in a materials handling facility are picking items that are to be consolidated or otherwise treated together, each user may select a different tote and move separately through the materials handling facility. As either user picks items and places those items into a corresponding tote, a profile item identifier list is updated to include an item identifier for each picked item.

Group shopping

Described is a system and method for proactively determining and resolving events having low confidence scores and/or resolving disputed events. For example, when an event, such as a pick of an item from an inventory location within a materials handling facility occurs, the event aspects (e.g., user involved in the event, item involved in the event, action performed) are determined based on information provided from one or more input components (e.g., camera, weight sensor). If each event aspect cannot be determined with a high degree of confidence, the event information is provided to an associate for resolution.

Event image information retention

Described is a system and method for presenting event information to a user and, if necessary, obtaining confirmation of different aspects (user, item, action) of the event. In some implementations, an event includes a user, an action, and an item. For example, an event may include a user picking an item from an inventory location, a user placing an item into a tote associated with the user, etc. if the aspects of the event cannot be determined with a high enough degree of confidence, a user interface may be generated and sent to the user requesting confirmation of one or more of the aspects of the event.

Item and action determination

A system may generate image data of users within a facility. Such users may be part of a group that is unknown to the system. The system can predict group data for two or more users based on a resemblance or the users being within a threshold distance of each other. However, if a confidence level associated with the predicted group data is below a threshold value, the group data is deemed unreliable and assistance from an associate is deemed necessary. A user interface that includes a portion of the image data, information about the predicted group data, and other interface elements is presented to the associate via a display. Based on the input data received from the associate, the group data can be confirmed or rejected. If the group data is confirmed, an association is made between the users and a group identifier.

Presentation of a user interface for confirming unreliable group data

Tote and item association

Event aspect determination

In one or more implementations, groups of users enter a facility within a short time. Automated systems attempt to predict a grouping for various users, but the predicted grouping may not exhibit a confidence level above a certain threshold level. In such cases, a user interface is generated and presented to an associate to confirm the grouping of users. The user interface includes an image gallery and interface elements that allow for the selection of users into a group. The image gallery includes previously stored images of users, such as images obtained during a registration process or during a previous visit to the facility. In addition, the user interface also includes image data obtained from a camera at the facility depicting visitors at various times or locations. Once a grouping has been selected or confirmed by an associate, group data may be generated and stored for the group of users.

Generation of image gallery for acquisition of group data

Proactive resolution of event information

Described are systems and techniques configured to determine a tote placement indicative of a position of a user relative to a tote, or vice versa. The determination may be based at least in part on data such as images acquired from cameras onboard the tote, images acquired from cameras external to the tote, proximity sensors onboard the tote, weight sensors, and so forth. Orientation of information presented on a display device of the tote may be based on the tote placement.

Determining position of a user relative to a tote

Described are systems for a materials handling facility to emit air from a floor which is used to generate an air cushion upon which one or more totes may move. The floor may contain one or more apertures which receive air from an air reservoir which is supplied by an air source such as a compressor. Air emitted by these apertures is constrained by a deck of the tote, forming an air cushion upon which the tote rests. In some implementations the air cushion may be maintained while a user is within a threshold distance, and discontinued when the user is beyond the threshold distance.

Air cushioned materials handling system

Tote association

Users may enter a facility singly or in groups. A user interface may be presented to an associate that includes information obtained from sensors in the facility. The associate may utilize the information presented to determine if a user is alone, or to associate that user with a particular group of users. Input from the associate obtained from this user interface may then be used by a facility management system during operation to attribute the actions of the users to a particular account.

User interface for acquisition of group data

Users may enter a facility singly or in groups. Users may present entry credentials to a scanner. The entry credentials assist in identification of the user. After entry, users are tracked within the facility. If determinations about one or more of identification or tracking by an automated system fall below a threshold value, an employee associated with the facility is presented with a user interface. The user interface may include a gallery of images including those of the user and others in the facility. User input to the user interface is then used to reestablish one or more of identification or tracking.

System for determining entry of user to an automated facility

Associating users with totes

Growing community of inventors

Seattle, WA, United States of America

Thomas Meilandt Mathiesen