Adaptive traffic signal control using approximate dynamic programming

Transportation Research Part C: Emerging Technologies

Volumn 17, Issue 5, 2009, Pages 456-474

  Cai, Chen ^a   Wong, Chi Kwong ^a   Heydecker, Benjamin G ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Adaptive; Approximation; Dynamic programming; Reinforcement learning; Traffic signal

Indexed keywords

CONTROLLERS; REINFORCEMENT LEARNING; TRAFFIC CONTROL; TRAFFIC SIGNALS;

ADAPTIVE; ADAPTIVE TRAFFIC SIGNAL CONTROL; APPROXIMATE DYNAMIC PROGRAMMING; APPROXIMATION; PERTURBATION LEARNING; SUBSTANTIAL REDUCTION; TEMPORAL DIFFERENCE LEARNING; TRAFFIC SIGNAL CONTROLLERS;

DYNAMIC PROGRAMMING;

ALGORITHM; COMPUTER SIMULATION; LEARNING; NUMERICAL METHOD; SIGNAL; TRAFFIC MANAGEMENT; TRANSPORTATION TECHNOLOGY;

EID: 67949102007     PISSN: 0968090X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.trc.2009.04.005     Document Type: Article

References (21)

1. Barto, A.G., Sutton, R.S., Anderson, C.W., 1983. Neuronlike elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man, and Cybernetics 13, 835-46. (Reprinted in Anderson, J.A., Rosenfeld E., 1988. Neurocomputing: Foundations of Research. MIT Press, Cambridge, MA.)
2. Bell, M.C., Bretherton, R.D., 1986. Ageing of fixed-time traffic signal plans. In: Proceedings of the Second IEE Conference on Road Traffic Control. IEE, London.
3. Bellman R. Dynamic Programming (1957), Princeton University Press, Princeton
4. Betsekas D.P., and Tsitsiklis J.N. Neuro-Dynamic Programming (1995), Athenas Scientific, Belmont, MA
5. Gartner N.H. OPAC: a demand-responsive strategy for traffic signal control. Transportation Research Record 906 (1983) 75-81
6. Henry J.J. PRODYN tests and future experiment on ZELT, vehicle navigation and information systems conference. Conference Record (1989) 292-295
7. Henry, J.J., Farges, J.L., Tuffal, J., 1983. The PRODYN real time traffic algorithm. In: Proceedings of the fourth IFAC-IFIP-IFORS conference on Control in Transportation Systems, pp. 307-311.
8. Hunt P.B., Robertson D.I., and Bretherton R.D. The SCOOT on-line traffic signal optimisation technique. Traffic Engineering and Control 23 (1982) 190-192
9. Luk J.Y.K. Two traffic-responsive area traffic control methods: SCAT and SCOOT. Traffic Engineering and Control 25 (1984) 14-22
10. Mauro, V., Di Taranto, C., 1989. UTOPIA. In: CCCT'89 - AFCET Proceedings, Paris.
11. Papadaki K., and Powell W.B. An adaptive dynamic programming algorithm for a stochastic multiproduct batch dispatch problem. Naval Research Logistics 50 7 (2003) 742-769
12. Powell, W.B., 2007. Approximate Dynamic Programming: Solving the Curses of Dimensionality. John Wiley & Sons, Inc., Hoboken, New Jersey, ISBN 978-0-470-17155-4.
13. Robertson, D.I., Bertherton, R.D., 1974. Optimum control of an intersection for any known sequence of vehicular arrivals. In: Proceedings of the second IFAC-IFIP-IFORS Symposium on Traffic Control and Transportation system, Monte Carlo.
14. Roess, R.P., Prassas, E.S., McShane, W.R., 2004. Traffic Engineering, third ed. Pearson Prentice Hall, Upper Saddle River. ISBN 0-13-142471-8.
15. Sutton R.S. Learning to predict by the methods of temporal differences. Machine Learning 3 (1988) 9-44
16. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, MA
17. Tsitsiklis J.N., and Van Roy B. An analysis of temporal difference learning with function approximation. IEEE Transactions on Automatic Control 42 5 (1997) 674-690
18. Van Roy, B., Bertsekas, D.P., Lee, Y., Tsitsiklis, J.N., 1997. A neurodynamic programming approach to retailer inventory management. In: Proceedings of the 36th IEEE Conference on Decision and Control, IEEE, vol. 4. pp. 4052-4057.
19. Vincent, R.A., Peirce, J.R., 1988. MOVA: traffic responsive, self-optimising signal control for isolated intersections, Transport and Road Research Laboratory Report RR 170. TRRL, Crowthorne.
20. Vincent, R.A., Mitchell, A.I., Robertson, D.I., 1980. User guide to TRANSYT version 8. Transport and Road Research Laboratory Report LR888, Crowthorne, Berkshire, UK.
21. Werbos, P., Pang, X., 1996. Generalized maze navigation: SRN critics solve what feedforward or hebbian nets cannot. In: World Congress on Neural Networks, San Diego, CA. Lawrence Erlbaum INNS Press, pp. 88-93.