Walmart Apollo, LLC

Ashlin Ghosh

Amit Jhunjhunwala

Lingfeng Zhang

Raghava Balusu

Srinivas Muktevi

Zhaoliang Duan

Benjamin R Ellison

Avinash Madhusudanrao Jade

Abhinav Pachauri

Mingquan Yuan

Han Zhang

William Craig Robinson

Siddhartha Chakraborty

Tianyi Mao

Zhiwei Huang

Systems and methods of creating reference template images for detecting and recognizing products at a product storage facility include an image capture device having a field of view that includes a product storage structure of the product storage facility, and a computing device including a control circuit and being communicatively coupled to the image capture device. The computing device obtains images of the product storage structure captured by the image capture device, analyzes the obtained images to detect individual ones of the products located on the product storage structure. Then, the computing device identifies the individual ones of the products detected in the images and crops each of the individual ones of the identified products from the images to generate cropped images. The computing device then creates a cluster of the cropped images, and selects one of the cropped images as a reference template image of an identified individual product.

Methods and systems for creating reference image templates for identification of products on product storage structures of a product storage facility

In some embodiments, apparatuses and methods are provided herein useful to processing captured images. In some embodiments, there is provided a system for processing captured images of objects at a product storage facility including a trained machine learning model; and a control circuit. The control circuit may group a plurality of product identifiers into one or more clusters based on at least one of visual similarity of corresponding images, textual similarity of corresponding associated descriptions, and associated relationships between product identifiers of the plurality of product identifiers; determine clusters having common elements that are at least within a similarity threshold of each other; merge the clusters with the common elements; and generate a mapping dataset used to retrain the trained machine learning model to identify a plurality of objects. The mapping dataset may include a plurality of associations of associated product identifiers to a single object.

Systems and methods for identifying different product identifiers that correspond to the same product

In some embodiments, apparatuses and methods are provided herein useful to processing captured images of objects at a product storage facility. In some embodiments, there is provided a system for processing captured images of objects including a trained machine learning model and a control circuit. In some embodiments, the trained machine learning model is configured to process unprocessed captured images. In some embodiments, the control circuit is configured to associate each of the processed images into one of a first group, a second group, or a third group; remove at least one processed image associated with the first group from the processed images in accordance with a first processing rule; and output remaining processed images associated with the first group and processed images associated with the second group to be used to retrain the trained machine learning model.

Systems and methods for processing images captured at a product storage facility

In some embodiments, apparatuses and methods are provided herein useful to processing captured images. In some embodiments, there is provided a system for processing captured images of objects including a memory and a control circuit executing a trained machine learning model. The memory may be configured to store a plurality of images comprising first images and second images. The control circuit may be configured to: allocate each of the first images into one of a plurality of datasets; cluster each image in the dataset into one of a plurality of groups; select a sample from at least one of the plurality of groups; cluster each of the second images into one of dominant product identifier group and a non-dominant product identifier group; select a sample from the dominant product identifier group and a sample from the non-dominant product identifier group; and output the selected sample.

Systems and methods for analyzing and labeling images in a retail facility

Systems and methods of updating templates for use in recognizing individual products in images captured at a product storage facility include an image capture device that captures one or more images of product storage structure at a product storage facility, a computing device in communication with the image capture device, and an electronic database that stores keyword model templates and feature model templates associated with images of previously recognized individual products detected at the product storage facility. The computing device obtains the keyword and feature model templates associated with a recognized product from the electronic database, extracts the keywords from the products associated with the obtained keyword model templates, identifies products that are similar to the recognized product, and updates the keyword model template for each of the products to include must keywords and negative keywords, facilitating recognition of products in subsequent images captured by the image capture device.

Systems and methods of updating model templates associated with images of retail products at product storage facilities

Systems and methods of monitoring inventory of a product storage facility include an image capture device configured to move about the product storage areas of the product storage facility and capture images of the product storage areas from various angles. A computing device coupled to the image capture device obtains the images of the product storage areas captured by the image capture device and processes the obtained images of the product storage areas to detect individual products captured in the obtained images. Based on detection of the individual products captured in the images, the computing device analyzes each of the obtained images to extract meta data from the packaging the individual products to detect one more keywords and determine the locations of the detected keywords on the packaging, and then utilize this information to predict an identity of the products associated with the packaging.

Growing community of inventors

Ernakulam, India

Ashlin Ghosh