The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 12566818 B1

Date of Patent:

Mar. 03, 2026

Filed:

Dec. 11, 2020

Crowdsourcing to filter out unpopular potential candidate answers

Applicant:

International Business Machines Corporation, Armonk, NY (US);

Inventors:

Huaiyu Zhu, Fremont, CA (US);

Yunyao Li, San Jose, CA (US);

Youxuan Jiang, Ypsilanti, MI (US);

Assignee:

INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US);

Attorney:

Amin, Turocy & Watson, LLP

Primary Examiner:

Tan H Tran

Int. Cl.

CPC ...

G06F 18/214 (2023.01); G06F 18/2113 (2023.01); G06F 40/205 (2020.01); G06F 40/30 (2020.01); G06N 20/00 (2019.01);

U.S. Cl.

CPC ...

G06F 18/2155 (2023.01); G06F 18/2113 (2023.01); G06F 40/205 (2020.01); G06F 40/30 (2020.01); G06N 20/00 (2019.01);

Abstract

Technology for selecting a correct answer (for example, a correct label for a data set to be used in machine learning algorithms) from among a plurality of candidate answers, where the answers selected relatively infrequently by a plurality of human evaluators are cold from the full plurality of candidate answers to obtain a reduced subset of candidate answers. In this way, further selection of the correct answer (for example, ultimate selection of the correct answer by a human expert) will only need to consider the reduced subset, thereby potentially saving time and effort in the selection of the correct answer.

Find Patent Forward Citations