The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 16, 2024
Filed:
Mar. 27, 2023
The United States of America As Represented BY the Secretary of the Navy, San Diego, CA (US);
Pedro Forero, San Diego, CA (US);
Peng Zhang, San Diego, CA (US);
Dusan Radosevic, San Diego, CA (US);
United States of America as represented by the Secretary of the Navy, Washington, DC (US);
Abstract
A reinforcement-learning based queue-management method for undersea networks. In one embodiment, a computer-implemented method to shape traffic in a dynamic network, comprising measuring network states, classifying each of a plurality of packets into one of a plurality of traffic types based on quality-of-service requirements, defining a decision epoch interval, determining a policy with a plurality of neural networks and with a deep reinforcement learning agent that maximizes entropy-regularized long-term reward and produces a plurality of weighted fair-queuing weights based on an observation of the state of the queues at the decision epoch intervals, and using the policy to allocate predefined portions of the available transmission bandwidth across the plurality of traffic types by defining each type with a WFQ weight.