University of Illinois

Mariya I Vasileva

David Alexander Forsyth

Krishna Dusad

Ranjitha Kumar

Yuan Shen

Shreya Rajpal

Kedan Li

Bryan Plummer

A search engine server includes a communication interface through which to receive a multi-modal query from a browser of a client device, the multi-modal query including at least a first image of an item. A processing device, coupled to the communication interface, is to: execute a neural network (NN) regressor model on the first image to identify a plurality of second items that are similar to and compatible with the item depicted in the first image, wherein a set of images correspond to the plurality of second items; generate structured text that explains, within one of a phrase or a sentence, why the set of images are relevant to the item; and return, to the browser of the client device via the communication interface, a set of search results comprising the set of images and the structured text.

Search engine use of neural network regressor for multi-modal item recommendations based on visual semantic embeddings

Growing community of inventors

Urbana, IL, United States of America

Mariya I Vasileva