Evaluating green-extension policies with reinforcement learning and Markovian traffic state estimation

Transportation Research Record

Volumn , Issue 2128, 2009, Pages 217-225

  Adam, Zain M ^a   Abbas, Montasir M ^a   Li, Pengfi ^a  

^a State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

STATE ESTIMATION; STREET TRAFFIC CONTROL; TRAFFIC SIGNALS; VEHICLES;

CONTROL AGENT; DILEMMA ZONE; LEARNING PROCESS; MARKOVIAN; NUMBER OF VEHICLES; OPTIMAL POLICIES; PROTECTION ALGORITHMS; REINFORCEMENT LEARNINGS; TRAFFIC STATE; TRAFFIC-STATE ESTIMATIONS;

REINFORCEMENT LEARNING;

EID: 76149142495     PISSN: 03611981     EISSN: None     Source Type: Journal    
DOI: 10.3141/2128-22     Document Type: Article

References (19)

1. Safe Car Guide. 2007. www.safecarguide.com/exp/statistics/statistics. htm. Accessed June 2007.
2. World Report on Road Traffic Injury Prevention. World Health Organization; World Bank. www.who.int/violence-injury-prevention/ publications/road-traffic/world-report/en/index.html. Accessed May 2007.
3. National Automotive Sampling System (NASS): General Estimates System (GES): Analytical User's Manual 1988-2001. NHTSA, U.S. Department of Transportation, 2001, p. 166.
4. Taking Action to Reduce Intersection Fatalities. Safety Compass Newsletter, Vol.1, No.2, March-April-May 2007. http://safety.fhwa. dot.gov/newsletter/safetycompass/2007/mar07-v1/index.cfm?story1. Accessed June 2009.
5. Bonneson, J., D. Middleton, K. Zimmerman, H. Charara, and M. M. Abbas. Intelligent Detection-Control System for Rural Signalized Intersections. Report FHWA/TX-03/4022-2. FHWA, U.S. Department of Transportation, 2002.
6. Kronborg, P., F. Davidsson, and J. Edholm. SOS-Self Optimising Signal Control: Development and Field Trials of the SOS Algorithm for Self-Optimising Signal Control at Isolated Intersections. TFK Report 1997:2E. Transport Research Institute, Stockholm, Sweden, 1997.
7. Kronborg, P., and F. Davidsson. MOVA and LHOVRA: Traffic Signal Control for Isolated Intersections. Traffic Engineering and Control, Vol.34, No.4, April 1993, pp. 195-200.
8. Peterson, A., T. Bergh, and K. Steen. LHOVRA: A New Traffic Signal Control Strategy for Isolated Junctions. Traffic Engineering and Control, Vol. 27, No. 7/8, July/August 1986, pp. 388-389. (Pubitemid 16634724)
9. Bullock, D. M., and T. Urbanik II. Traffic Signal Systems: Addressing Diverse Technologies and Complex User Needs. In Transportation in the New Millennium: State of the Art and Future Directions, TRB, National Research Council, Washington, D.C., 2000.
10. Sutton, R. S., and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, Mass., 1998.
11. Ou, H., W. Zhang, and X. Xu. Urban Intelligent Traffic Control System Based on Multi-Agent Technology. Acta Electronica Sinica, Vol.28, No.12, 2000, pp. 52-55.
12. Ma, S., Ying Lee, and Leopard Liv. Agent-Based Learning Control Method for Urban Traffic Signal of Single Intersection. Journal of Systems Engineering, Vol.17, No.6, 2002, pp. 526-530.
13. Thorpe, T. Vehicle Traffic Light Control Using SARSA. MS thesis. Colorado State University, Fort Collins, 1997.
14. Abdulhai, B., R. Pringle, and G. Karakoulas. Reinforcement Learning for True Adaptive Traffic Signal Control. Journal of Transportation Engineering, ASCE, Vol.129, No.3, 2003, pp. 278-285.
15. Wiering, M. Multi-Agent Reinforcement Learning for Traffic Light Control. In Machine Learning: Proceedings of the Seventeenth International Conference, Stanford, Calif., Morgan Kaufmann Publishers, San Francisco, Calif., 2000, pp. 1151-1158.
16. Jacob, C., and B. Abdulhai. Integrated Traffic Corridor Control Using Machine Learning Proc., IEEE International Conference on Systems, Man and Cybernetics, Vol.4, 2005, pp. 3460-3465.
17. Bingham, E. Reinforcement Learning in Neuro-Fuzzy Traffic Signal Control. European Journal of Operational Research, Vol.131, No.2, June 2001, pp. 232-241.
18. Stewart, W. J. Introduction to the Numerical Solution of Markov. Princeton University Press, Princeton, N.J., 1994.
19. VisSim 4.30 User Manual. Planung Transport Verkehr AG, Karlsruhe, Germany, 2007.