The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Mar. 31, 2026

Filed:

Dec. 19, 2023
Applicant:

Lemon Inc., Grand Cayman, KY;

Inventors:

Yuanshun Yao, Los Angeles, CA (US);

Xiaojun Xu, Los Angeles, CA (US);

Yang Liu, Los Angeles, CA (US);

Assignee:

Lemon Inc., Grand Cayman, KY;

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06F 40/40 (2020.01);
U.S. Cl.
CPC ...
G06F 40/40 (2020.01);
Abstract

A computing system including one or more processing devices configured to receive a forgetting dataset including forgetting-target prompt-output pairs. The forgetting-target prompt-output pairs each include a forgetting-target prompt that has been input into a generative language model and a forgetting-target output generated at the generative language model. The processing devices are further configured to receive a remembering dataset including remembering-target prompt-output pairs that each include a remembering-target prompt that has been input into the generative language model and a remembering-target output generated at the generative language model. The processing devices are further configured to compute an unlearning loss term and a remembering loss term based at least in part on the forgetting dataset and the remembering dataset, respectively. The processing devices are further configured to perform unlearning updates at the generative language model by performing gradient descent with respect to a loss that includes the loss terms.


Find Patent Forward Citations

Loading…