Microsoft Technology Licensing, LLC

Rui Xia

Arun Sacheti

Houdong Hu

Li Huang

Meenaz Merchant

Kuang-Huei Lee

Linjun Yang

Sean Chang Culatana

Xi Chen

Jiapei Huang

Representative embodiments disclose mechanisms to perform visual intent classification or visual intent detection or both on an image. Visual intent classification utilizes a trained machine learning model that classifies subjects in the image according to a classification taxonomy. The visual intent classification can be used as a pre-triggering mechanism to initiate further action in order to substantially save processing time. Example further actions include user scenarios, query formulation, user experience enhancement, and so forth. Visual intent detection utilizes a trained machine learning model to identify subjects in an image, place a bounding box around the image, and classify the subject according to the taxonomy. The trained machine learning model utilizes multiple feature detectors, multi-layer predictions, multilabel classifiers, and bounding box regression.

Visual intent triggering for visual search

Growing community of inventors

Vancouver, Canada

Rui Xia