The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 17, 2023
Filed:
Nov. 05, 2019
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Yiping Yuan, Sunnyvale, CA (US);
Ajith Muralidharan, Sunnyvale, CA (US);
Shaunak Chatterjee, Sunnyvale, CA (US);
Preetam Nandy, Santa Clara, CA (US);
Shipeng Yu, Sunnyvale, CA (US);
Miao Cheng, Sunnyvale, CA (US);
Microsoft Technology Licensing, LLC, Redmond, WA (US);
Abstract
Methods, systems, and computer programs are presented for scheduling user notifications to maximize short-term and long-term benefits from sending the notifications. One method includes an operation for identifying features of a state used for reinforcement learning. The state is associated with an action to decide if a notification to a user is to be sent and a reward for sending the notification to the user. Further, the method includes capturing user responses to notifications sent to users to obtain training data and training a machine-learning (ML) algorithm with reinforcement learning based on the features and the training data to obtain an ML model. Additionally, the method includes receiving a request to send a notification to the user, and deciding, by the ML model, whether to send the notification based on a current state. The notification is sent to the user based on the decision.