The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Mar. 24, 2026

Filed:

Jul. 02, 2021
Applicant:

Adobe Inc., San Jose, CA (US);

Inventors:

Saayan Mitra, San Jose, CA (US);

Xiang Chen, Palo Alto, CA (US);

Vahid Azizi, Piscataway, PA (US);

Assignee:

Adobe Inc., San Jose, CA (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06N 3/044 (2023.01); G06F 18/21 (2023.01); G06N 3/088 (2023.01); G06Q 30/0202 (2023.01); G06Q 30/0601 (2023.01);
U.S. Cl.
CPC ...
G06Q 30/0631 (2013.01); G06F 18/2178 (2023.01); G06N 3/044 (2023.01); G06N 3/088 (2013.01); G06Q 30/0202 (2013.01);
Abstract

The present disclosure relates to systems, methods, and non-transitory computer readable media that utilize collaborative filtering and a reinforcement learning model having an actor-critic framework to provide digital content items across client devices. In particular, in one or more embodiments, the disclosed systems monitor interactions of a client device with one or more digital content items to generate item embeddings (e.g., utilizing a collaborative filtering model). The disclosed systems further utilize a reinforcement learning model to generate a recommendation (e.g., determine one or more additional digital content items to provide to the client device) based on the user interactions. In some implementations, the disclosed systems utilize the reinforcement learning model to analyze every negative and positive interaction observed when generating the recommendation. Further, the disclosed systems utilize the reinforcement learning model to analyze item embeddings, which encode the relationships among the digital content items, when generating the recommendation.


Find Patent Forward Citations

Loading…