The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 13, 2015
Filed:
Jun. 15, 2009
Krysta M. Svore, Seattle, WA (US);
Elbio Renato Torres Abib, Redmond, WA (US);
Christopher J. C. Burges, Bellevue, WA (US);
Bhuvan Middha, Redmond, WA (US);
Krysta M. Svore, Seattle, WA (US);
Elbio Renato Torres Abib, Redmond, WA (US);
Christopher J. C. Burges, Bellevue, WA (US);
Bhuvan Middha, Redmond, WA (US);
Microsoft Corporation, Redmond, WA (US);
Abstract
Described is a technology for identifying sample data items (e.g., documents corresponding to query-URL pairs) having the greatest likelihood of being mislabeled when previously judged, and selecting those data items for re-judging. In one aspect, lambda gradient scores (information associated with ranked sample data items that indicates a relative direction and how 'strongly' to move each data item for lowering a ranking cost) are summed for pairs of sample data items to compute re-judgment scores for each of those sample data items. The re-judgment scores indicate a relative likelihood of mislabeling. Once the selected sample data items are re-judged, a new training set is available, whereby a new ranker may be trained.