Manuscript in preparationReinforcement LearningCurrent4 min read

Extending Intelligent Traffic Control with Deep Q-Learning — Work in Progress

A short update on the control-side continuation of my M.S. thesis, extending the Deep Q-Learning traffic-signal-control research before submission for peer review.

Authors: Pouria Maleki
Extending Intelligent Traffic Control with Deep Q-Learning — Work in Progress — research article by Pouria Maleki

My 2021 M.S. thesis at Bu-Ali Sina University focused on adaptive traffic-signal control with Reinforcement Learning and Deep Q-Learning. The work modeled a four-way intersection in SUMO, represented traffic state for sequential decision-making, and used a neural-network-based Q-learning agent to select signal phases according to traffic conditions.

Current research continuation

The control side of that research is now being developed into a new manuscript. The new work remains part of the Deep Q-Learning traffic-control line, with an updated formulation and broader evaluation being prepared for peer review.

Because the manuscript is not yet published, I am intentionally keeping unpublished methodological details and full result tables off the public website.

Research lineage

This work is part of one continuous research path:

M.S. Deep Q-Learning traffic-control thesis → vehicle perception → public vehicle datasets → published object-detection papers → new traffic-control manuscript

After submission and peer review, this page can be updated with the final bibliographic record and the technical details that are appropriate to publish.

Related research

An Intelligent Traffic Light Control System Using Deep Neural Networks — research by Pouria Maleki
M.S. thesis noteReinforcement Learning
20217 min read

An Intelligent Traffic Light Control System Using Deep Neural Networks

Bu-Ali Sina University · M.S. Thesis

My 2021 M.S. thesis used Reinforcement Learning with Deep Q-Learning, SUMO simulation and YOLO-based traffic estimation for adaptive traffic-signal control.

SUMO provides the traffic environment while Deep Q-Learning drives sequential signal decisions
Read article