Amazon Technologies, Inc.

Ammar Chinoy

Sudarshan Narasimha Raghavan

Yasser Baseer Asmi

Emilio Ian Maldonado

Dilip Kumar

Daniel Bibireata

Shrivatsan Vasudhevan

Nishitkumar Ashokkumar Desai

Joachim Sebastian Stahl

Pranab Mohanty

Jason Michael Famularo

Jin Dong Kim

Frank Florian Liberato, Jr

Hao Jiang

Korwin Jon Smith

Gianna Lise Puerini

Jared Joseph Frank

Muralidhar Koka

Sridhar Boyapati

Alexander Michael McNamara

Amber Autrey Taylor

Aaron Craig Thompson

David Echevarria Ignacio

David Allen Smith

Jiajun Zhao

Maxwell Aaron Corman

Diwakar Gupta

Ashish Kumar Agrawal

Chih-Jen Huang

Jon Robert Ducrou

Michel Leonard Goldstein

Philip Yuen

Kiran Kumar Meduri

Christopher Andrew Stephens

Ismael Medrano

Paul C Schattauer

Prithviraj Banerjee

Amit Bhosle

Jaechul Kim

Elie Micah Kornfield

Michael Donikian

This disclosure describes a system for disambiguating between multiple potential users that may have performed an item action (e.g., item removal or item placement) at an inventory location. For example, if there are three picking agents (users) standing near an inventory location and one of the agents removes an item (item action) from the inventory location, the example systems and processes described herein may utilize various inputs to disambiguate between the users and determine which of the potential users performed the item action.

Disambiguating between users

Users in a facility may move about and their authentication status may change accordingly. For example, upon entering a facility, a user may present identification data. At that point, the user is considered an authenticated user with persistent profile data. However, the identification of a user may not be presented at entry or may be unreliable, which causes the user to be considered an unauthenticated user with temporary profile data. In other scenarios, the identification of authenticated users may become unreliable based on their location or their proximity to other users. In cases where users are crowded at a location, the profile data for such users may be aggregated and may be based on common settings of the set of possible users in the group. A user interface may be presented to a user based on their designated profile data.

System for managing profile data for users in a facility

Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.

Store tracking system

Described is a system and method for collecting item and user information and utilizing that information to determine materials handling facility patterns, item trends and inventory location trends. User monitoring data for users located in a materials handling facility may include information identifying inventory locations approached by users, gaze directions of users, user dwell times, an identification of items picked by users, an identification of items placed by users, and/or in-transit times for items. This information may be aggregated and processed to determine materials handling facility patterns, item trends and/or inventory location trends.

Determining trends from materials handling facility information

Described is a multiple-camera system and process for re-identifying a user located in a materials handling facility based on user patterns and/or descriptors representative of the user. In one implementation, a user pattern and/or a plurality of descriptors representative of a user are maintained as a position of a user is tracked through a materials handling facility. If the tracking of the user is lost, the last known position is stored with the user pattern and/or descriptors. If a new object is detected and confirmed to be a user, a user pattern and/or descriptors of the new object are compared with the stored user pattern and/or descriptors to determine if the new object is the user.

Updating a position of a user within a materials handling facility

Described are systems and techniques configured to authenticate a user upon entry to a facility. Prior to entry, the user may log in to a secure website with valid credentials, whereupon a login image of the user at the time of login is acquired. In one implementation, optically encoded data is generated which includes data representative of the login image, an acquisition timestamp, and an identifier value. At entry of the user to the facility, an entry image of the user's face, an image of the optically encoded data as presented on a display of a computing device in possession of the user, and an entry timestamp are acquired. By determining the timestamp is within a valid range of time and the data representative of the login image corresponds to the entry image, the user is authenticated to the identifier value.

User authentication system

Determining an item involved in an event at an event location

Markers may be presented on different objects in a facility, such as shelves or totes. A marker can use color, placement of elements, blending effects, or infrared light layers to encode data about the object. During operation, a camera within the facility may acquire an image, which includes an image of the marker as presented on the object. The marker can be analyzed to detect marker data encoded therein. By decoding the marker data, details about the marker can be extracted, such as an identification of the object. In addition, using details about the marker location within the image and location data associated with the camera, a location of the object relative to the camera can be determined, as well as an orientation of the object relative to the camera. As the object moves within the facility, the object can be tracked based on this location and orientation data.

Tracking of objects using markers

Described are systems and techniques configured to provide a user interface for an unauthenticated user of a materials handling facility. A transient profile indicative of one or more user preferences may be created and associated with the unauthenticated user. As the unauthenticated user interacts with the facility, preferences may be determined and included in the transient profile. Subsequent operation of the facility may take into account the transient profile. As the unauthenticated user moves throughout the facility, the transient profile may 'follow' them, providing an ongoing user experience. Should the unauthenticated user later be authenticated, the transient preferences may be incorporated into a persistent profile.

User interface preference management

This disclosure describes a system for assisting users in locating items from inventory locations and/or obtaining additional information about items. In some instances, a user may experience difficulty in locating an inventory item in a materials handling facility. By detecting one or more expressions presented by the user, an inventory management system may determine that assistance is to be provided to the user, determine and provide the appropriate assistance to the user.

Expression and gesture based assistance

Described is a multiple-camera system and process for detecting a user within a materials handling facility and tracking a position of the user as the user moves through the materials handling facility. In one implementation, a plurality of depth sensing cameras are positioned above a surface of the materials handling facility and oriented to obtain a top-down view of the surface of the materials handling facility, along with any objects (e.g., users) on the surface of the materials handling facility. The depth information from the cameras may be utilized to detect objects on the surface of the materials handling facility, track a movement of those objects and determine if those objects are users.

Collecting user pattern descriptors for use in tracking a movement of a user within a materials handling facility

Access to items stored within an inventory location of a facility may be controlled using physical access control mechanisms. A user within a facility is detected by sensors, such as imaging sensors. Context data for the user is generated based on the sensor data. The context data includes permission data indicative of portions of the inventory location that are accessible or inaccessible to the user. In addition, a predicted path of the user may also be determined based on historical data of the user or other users of the facility. Using the permission data and the predicted path of the user, configuration data may be generated to specify the level of access control to be applied to the different portions of the inventory location. The configuration data is sent to access control mechanisms of the inventory location to prevent or allow access to such portions of the inventory location.

Controlling access to items in an inventory location

Growing community of inventors

Seattle, WA, United States of America

Ammar Chinoy