Company Filing History:
Years Active: 2019-2025
Title: The Innovations of John Quan
Introduction
John Quan is a prominent inventor based in London, GB. He has made significant contributions to the field of reinforcement learning, holding a total of 6 patents. His work focuses on developing methods and systems that enhance the capabilities of neural networks in various applications.
Latest Patents
Among his latest patents is "Reinforcement learning using distributed prioritized replay." This patent describes methods, systems, and apparatuses, including computer programs encoded on computer storage media, for training an action selection neural network. This network is used to select actions performed by an agent interacting with an environment. The system includes a plurality of actor computing units, each configured to maintain a respective replica of the action selection neural network and perform various actor operations. Additionally, it features one or more learner computing units that are designed to execute a range of learner operations.
Another notable patent is "Training neural networks using a prioritized experience memory." This invention outlines methods, systems, and apparatuses for training a neural network that selects actions for a reinforcement learning agent. The method involves maintaining a replay memory that stores experience data generated from the agent's interactions with the environment. Each piece of experience data is linked to an expected learning progress measure, which indicates the anticipated progress in training the neural network. The method prioritizes selection of experience data with higher expected learning progress measures for training purposes.
Career Highlights
John Quan is currently employed at DeepMind Technologies Limited, where he continues to innovate in the field of artificial intelligence. His work has been instrumental in advancing the understanding and application of reinforcement learning techniques.
Collaborations
Some of his notable coworkers include Tom Schaul and David Silver, who are also recognized for their contributions to the field of artificial intelligence.
Conclusion
John Quan's innovative work in reinforcement learning and neural networks has positioned him as a key figure in the field. His patents reflect a commitment to advancing technology and improving the capabilities of artificial intelligence systems.