The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 21, 2026

Filed:

May. 14, 2021
Applicant:

Spotify Ab, Stockholm, SE;

Inventors:

Christian Hansen, Copenhagen, DK;

Casper Hansen, Copenhagen, DK;

Brian Christian Peter Brost, New York City, NY (US);

Lucas Maystre, London, GB;

Mounia Lalmas-Roelleke, Saffron Walden, GB;

Rishabh Mehrotra, London, GB;

Assignee:

Spotify AB, Stockholm, SE;

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06N 3/044 (2023.01); G06N 3/042 (2023.01); G06N 3/0442 (2023.01); G06N 3/045 (2023.01); G06N 3/0499 (2023.01); G06N 3/08 (2023.01); G06N 3/092 (2023.01);
U.S. Cl.
CPC ...
G06N 3/042 (2023.01); G06N 3/044 (2023.01); G06N 3/08 (2013.01);
Abstract

A reinforcement learning ranker can take into account previously-recommended media content items to produce a ranked list of media content items to recommend next. The ranker finds a policy that gives the probability of sampling a media content item given a state. The policy is learned such that it maximizes a reward. A reward function associated with the media content item can be defined with respect to whether the user finds the media content item relevant (likelihood that the user will like the media content item) and a diversity score of the media content item.


Find Patent Forward Citations

Loading…