Walmart Apollo, LLC

Omer Ovenc

Behzad Ahmadi

Venkatesh Kandaswamy

Abilash Amarthaluri

Alessandro Magnani

Abon Chaudhuri

Shreyansh Prakash Gandhi

Theban Stanley

Ashish Kumar Gupta

Zuzar Fakhruddin Nafar

Rohit Deep

Binwei Yang

Zheng Yan

Cun Mu

Anthony Soohoo

Jun Zhao

Qian Li

Guang Yang

Karthik Deivasigamani

Vijay Raghavendra

Suleman Ashfaq

Sreyash D Kenkre

Charles Myslinsky

Harman Kochar

Arvind Senthil Kumaran

Samrat Kokkula

A method including pre-screening second images from a database for a search result based on a first image and also based on respective substring distances between first binary substrings for the first image and respective second binary substrings for each of the second images. The method further can include after the pre-screening, determining a respective image distance for each third image of third images of the search result, wherein the respective image distance is between the first image and the each third image of the third images of the search result, and after determining the respective image distance for each third image of the third images of the search result, when the respective image distance for a particular one of the third images is greater than a predetermined image distance threshold, removing the particular one of the third images from the search result before the search result is displayed on a user device requesting the search result. Other embodiments are disclosed.

Image searching using a full-text search engine

A method including bit-operation and sub-code/substring filtering for image searching using a full-text search engine. The method can include determining a first binary vector comprising first binary substrings for a first image. The method also can include obtaining a respective second binary vector comprising second binary substrings for each of second images from a database. The method additionally can include determining a respective substring distance for each of the binary substring for each of the second images. The respective substring distance can be between at least a pair of a first binary substring of the first binary substrings of the first binary vector and a respective corresponding second binary substring of the second binary substrings of the respective second binary vector for each of the second images. In some embodiments, the method further can include after determining the respective substring distance for each of the binary substring for each of the second images, when the respective substring distance for one or more of the second images is not greater than a predetermined substring distance threshold, including the one or more of the second images in a search result. The method also can include determining a respective image distance for each respective third image of the search result, the respective image distance being between the first image and the each respective third image of the search result. The method additionally can include after determining the respective image distance for the each respective third image of the search result, when the respective image distance is greater than the predetermined image distance threshold, culling the each respective third image from the search result. Other embodiments are disclosed.

A system can include one or more processors and non-transitory computer-readable media storing computing instructions configured to run on the one or more processors and perform a method for determining one or more substitutes for a product requested in an inquiry from a user. The method comprises one or more of the steps including receiving an inquiry from a user, which comprises a requested product; extracting one or more attributes of the requested product based on the inquiry; determining a context of the inquiry; and determining one or more substitutes for the requested product from an inventory database based on a distance between the requested product and each substitute of the one or more substitutes, as projected in a product graph relating to a domain of the requested product and the context of the inquiry. In many embodiments, the product graph relating to the domain is generated by a machine learning module configured to dynamically learn information about the domain from various sources, including one or more expert opinions, the inventory database, and/or public records; and dynamically build the product graph according to the information about the domain. An exemplary machine learning module can be configured to dynamically build the product graph by: creating one or more product categories in the domain; extracting one or more entity nodes from the one or more product categories based on the information about the domain; and build one or more connections, including an entity-entity connection between each pair of related entity nodes, a product-entity connection between each product node and each of one or more entity nodes associated with the each product node, and a product-product connection between each pair of related product nodes. Other embodiments are disclosed.

System and method for determining substitutes for a requested product

A system can include one or more processors and non-transitory computer-readable media storing computing instructions configured to run on the one or more processors and perform a method for determining one or more substitutes for a product requested in an inquiry from a user and the order of the one or more substitutes to be transmitted to the user. The method can comprise: receiving an inquiry from a user, wherein the inquiry comprises an image and a text describing a requested product; extracting one or more visual attributes of the requested product based on the image; extracting one or more textual attributes of the requested product based on the text; determining a first projected requested product, in a product graph relating to a domain of the requested product, based on the one or more visual attributes of the requested product; determining a second projected requested product in the product graph based on the one or more textual attributes of the requested product; and determining one or more substitutes for the requested product. In this embodiment, the one or more substitutes for the requested product can be determined by: determining one or more first candidates, each first candidate of the one or more first candidates existing in both the product graph and an inventory database and comprising a visual distance between the first projected requested product and the each first candidate in the product graph; determining one or more second candidates, each second candidate of the one or more second candidates existing in both the product graph and the inventory database and comprising a textual distance between the second projected requested product and the each second candidate in the product graph, the one or more substitutes comprising the one or more first candidates and the one or more second candidates; determining a score of a candidate substitute of the one or more substitutes based on a visual distance and a textual distance of the candidate substitute of the one or more substitutes; and sorting the one or more substitutes based on the score of the candidate substitute of the one or more substitutes. In this embodiment, after the one or more substitutes are determined and sorted, this method can further comprise: in response to receiving the inquiry from the user, automatically transmitting to the user higher ranked ones of the one or more substitutes. Additionally, in this embodiment, the product graph can be dynamically generated by a machine learning module based on information about the domain of the requested product; and the product graph can comprise: (a) one or more product nodes, the one or more product nodes comprising the one or more substitutes; (b) one or more entity nodes, the one or more entity nodes comprising the one or more visual attributes and the one or more textual attributes of the requested product; (c) one or more entity-entity connections between each pair of related entity nodes of the one or more entity nodes; (d) one or more product-entity connections between a product node of the one or more product nodes and an entity node of the one or more entity nodes, wherein the entity node is related to the product node; and (e) one or more product-product connection between a first product node of the one or more product nodes and a second product node of the one or more product nodes, wherein the first product node and the second product node are determined to be substitutable by or complimentary of each other. Other embodiments are disclosed.

System and method for determining substitutes for a requested product and the order to provide the substitutes

Systems and methods including one or more processors and one or more non-transitory storage devices storing computing instructions configured to run on the one or more processors and perform acts of receiving a digital image comprising multiple items; determining an embedding for the digital image using a machine learning algorithm trained on one or more combined digital images, the combined digital image comprising one or more annotated digital images; identifying an item of the multiple items in the digital image; and facilitating an alteration of a GUI on an electronic device in response to identifying the item in the digital image.

Systems and methods for identifying items in a digital image

Systems and methods including one or more processors and one or more non-transitory storage devices storing computing instructions configured to run on the one or more processors and perform acts of receiving one or more digital images from a repository of digital images; annotating the one or more digital images from the repository of digital images; digitally altering the one or more digital images, as annotated, from the repository of digital images; digitally combining the one or more digital images, as annotated and digitally altered, with at least one or more portions of one or more other digital images of the repository of digital images to create one or more combined digital images; training a machine learning algorithm on the one or more combined digital images; and storing the machine learning algorithm, as trained, in the one or more non-transitory computer readable storage devices.

Systems and methods including one or more processing modules and one or more non-transitory storage modules storing computing instructions configured to run on the one or more processing modules and perform acts of: receiving an image at a first-level analysis component comprising a first neural network structure; analyzing, using the first neural network structure of the first-level analysis component, the image to determine an image category associated with the image; selecting at least one second-level analysis component that is associated with the image category to analyze the image; analyzing, using a second neural network structure associated with the at least one second-level analysis component that was selected, the image to determine whether the image includes non-compliant content; and in response to determining that the image includes non-compliant content, executing a corrective measure. Other embodiments are disclosed herein.

Systems and methods for detecting content in images using neural network architectures

Growing community of inventors

San Jose, CA, United States of America

Omer Ovenc