The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 08, 2024

Filed:

Dec. 30, 2022
Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Xiulian Peng, Beijing, CN;

Vinod Prakash, Redmond, WA (US);

Xiangyu Kong, Beijing, CN;

Sriram Srinivasan, Sammamish, WA (US);

Yan Lu, Beijing, CN;

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
H04L 47/283 (2022.01); G06F 18/21 (2023.01); G06F 18/214 (2023.01); G06N 20/00 (2019.01); H04L 41/14 (2022.01); H04L 41/16 (2022.01); H04L 43/087 (2022.01);
U.S. Cl.
CPC ...
H04L 41/16 (2013.01); G06F 18/214 (2023.01); G06F 18/217 (2023.01); G06N 20/00 (2019.01); H04L 41/145 (2013.01); H04L 43/087 (2013.01); H04L 47/283 (2013.01);
Abstract

Disclosed in some examples are methods, systems, and machine-readable mediums which determine jitter buffer delay by inputting jitter buffer and currently observed network status information to a machine learned model that is trained using a reinforcement learning (RL) method. The model maps these inputs to an action to compress, stretch, or hold the jitter buffer delay, which is used by a recipient computing device to optimize the jitter buffer delay. The model may be trained using a simulator that uses network traces of past real streaming sessions (e.g., communication sessions) of users. By training the model through reinforcement learning, the model learns to make better decisions through reinforcement in the form of reward signals that reflect the performance of each decision.


Find Patent Forward Citations

Loading…