Maplebear Inc.

Spencer Schack

Dominic Cocchiarella

Andrew Peters

Brandon Leonardo

Aditya Godbole

Samuel Slezek

An automated checkout system aims to detect and disable certain functionalities of an auto-checkout client application if a user exhibits anomalous behavior. The system collects user interaction data to describe the user's interactions with the client device through the application. It then uses a behavior scoring model on the data to generate an anomalous behavior score, indicating the likelihood of anomalous behavior. For instance, if a user scans an item far from its usual location, the score may suggest atypical behavior. The system employs the behavior score to identify functionalities to disable by comparing it to a set of threshold values. Each threshold corresponds to specific auto-checkout application functionalities to be disabled if the behavior score reaches the thresholds. For example, if a threshold is related to identifying items by image capture, the system may disable this feature if the score exceeds the threshold value.

Disabling functionality of an auto-checkout client application based on anomalous user behavior

A wayfinding application executing on a client device receives a current location of the device within a warehouse and accesses a layout of the warehouse describing locations of items included among an inventory of the warehouse. The application identifies a route from the current location to one or more locations within the warehouse associated with one or more target items, generates augmented reality elements including instructions for navigating the route, and sends the elements to a display area of the device. The application detects a location within the warehouse associated with a target item and determines whether the item is at the location based on an image captured by the device. Upon determining it is not at the location, the application alerts a user of the device to a replacement item by generating an augmented reality element that calls attention to it and sending the element to the display area.

Method, computer program product, and system for displaying augmented reality elements for navigating to a location of an item within a warehouse

An augmented reality application executing on a client device receives video data captured by a camera of the device, in which the video data includes a display area of the device. The application detects a set of items within the display area based on the video data, wherein the set of items is included among an inventory of a warehouse associated with a retailer, and accesses a set of attributes of each item. The application retrieves profile information including a set of preferences associated with a customer of the retailer, matches one or more of the set of preferences with one or more attributes of each item, and generates an augmented reality element based on the matches. The augmented reality element is then displayed, such that it is overlaid onto a portion of the display area based on a location within the display area at which the items are detected.

Growing community of inventors

Seattle, WA, United States of America

Spencer Schack