University of Toronto

Huawei Cloud Computing Technologies Co., Ltd.

Baher Abdulhai

Hao Hai Ma

Yi Huo

Parth Jaggi

Scott Sanner

Soheil Mohamad Alizadeh Shabestary

Soheil Shabestary

There is provided a system and method for traffic signal control of a traffic network with a learned model. The method including: receiving sensor readings from the traffic network, the sensor readings including positions and speeds of vehicles approaching each intersection; using a learned dynamics model that takes the sensor readings as input, predicting a plurality of possibilities for position and velocity of the vehicles approaching each intersection in a future timestep; determining a action for the one or more intersections by performing a tree search on the plurality of possibilities and selecting the possibility with a highest action value; and outputting the action to the traffic network for implementation as a traffic control action at the one or more intersections.

Method and system for traffic signal control with a learned model

Methods, systems, and processor-readable media for adaptive cycle-level traffic signal control are described. An adaptive cycle-level traffic signal controller and control method that operate within a continuous action space. A reinforcement learning algorithm called Proximal Policy Optimization (PPO), which is a type of actor-critic model for reinforcement learning, may be used to generate signal cycle phase durations selected from a continuous range of values. The controller thus does not treat the action space as discrete, but instead produces continuous values as output. The generated phase durations may define a full traffic signal cycle. The inputs to the controller may indicate current and past states of the traffic environment. The average duration of delay of vehicles in the traffic environment may be used to calculate the reward for the reinforcement learning model that drives the behavior of the controller.

Method and system for adaptive cycle-level traffic signal control

Growing community of inventors

Mississauga, Canada

Baher Abdulhai