logo

For the Inventor, By the Inventor

The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 11928875 B1

PDFFull Text
Date of Patent:
Mar. 12, 2024

Filed:

Mar. 08, 2019

Layout-aware, scalable recognition system

Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Yan Wang, Mercer Island, WA (US);

Ye Wu, Bothell, WA (US);

Arun Sacheti, Sammamish, WA (US);

Assignee:

MICROSOFT TECHNOLOGY LICENSING, LLC, Redmond, WA (US);

Attorney:

Calfee, Halter & Griswold LLP

Primary Examiner:

Matthew C Bella

Assistant Examiner:

Dennis Rosario

Int. Cl.
CPC ...
G06F 16/387 (2019.01); G06F 16/31 (2019.01); G06F 16/35 (2019.01); G06F 18/2411 (2023.01); G06N 20/10 (2019.01); G06V 10/70 (2022.01); G06V 10/75 (2022.01); G06V 10/80 (2022.01); G06V 20/62 (2022.01); G06V 30/144 (2022.01); G06V 30/148 (2022.01); G06V 30/18 (2022.01); G06V 30/19 (2022.01); G06V 30/413 (2022.01); G06V 30/414 (2022.01); G06V 30/10 (2022.01);
U.S. Cl.
CPC ...
G06V 30/18171 (2022.01); G06F 16/313 (2019.01); G06F 16/35 (2019.01); G06F 16/387 (2019.01); G06F 18/2411 (2023.01); G06N 20/10 (2019.01); G06V 10/70 (2022.01); G06V 10/75 (2022.01); G06V 10/806 (2022.01); G06V 20/62 (2022.01); G06V 30/144 (2022.01); G06V 30/153 (2022.01); G06V 30/158 (2022.01); G06V 30/1916 (2022.01); G06V 30/19173 (2022.01); G06V 30/413 (2022.01); G06V 30/414 (2022.01); G06V 30/10 (2022.01);
Abstract

Described herein is a mechanism for visual recognition of items or visual search using Optical Character Recognition (OCR) of text in images. Recognized OCR blocks in an image comprise position information and recognized text. The embodiments utilize a location-aware feature vector created using the position and recognized information in each recognized block. The location-aware features of the feature vector utilize position information associated with the block to calculate a weight for the block. The recognized text is used to construct a tri-character gram frequency, inverse document frequency (TGF-IDP) metric using tri-character grams extracted from the recognized text. Features in location-aware feature vector for the block are computed by multiplying the weight and the corresponding TGF-IDF metric. The location-aware feature vector for the image is the sum of the location-aware feature vectors for the individual blocks.

Find Patent Forward Citations

Loading…