Systems and methods for generating virtual tags for items in a physical environment

Abstract

Disclosed are methods and systems for generating a virtual tag for an item in a physical environment. For instance, an image of the physical environment captured by and displayed on a user interface of a computing device may be provided as input to a trained machine learning model configured to identify the item including a first subset of item attributes. The item may be identified and information associated with the item, including a second subset of item attributes, may be received from a data store using the first subset. A spatial location of the item may be identified in the image. An icon may be generated for the item and rendered by the computing device for display on the user interface in association with the spatial location of the item in the image. The icon may be indicative of at least one item attribute from the first or second subset.