DHP method for ramp metering of freeway traffic

IEEE Transactions on Intelligent Transportation Systems

Volumn 12, Issue 4, 2011, Pages 990-999

  Zhao, Dongbin ^a   Bai, Xuerui ^a   Wang, Fei Yue ^a,b   Xu, Jing ^c   Yu, Wensheng ^d  

^a INSTITUTE OF AUTOMATION   (China)

^b University of Arizona   (United States)

^c IBM CHINA RESEARCH LAB   (China)

^d EAST CHINA NORMAL UNIVERSITY   (China)

Author keywords

Congestion; dual heuristic programming (DHP); ramp metering; traffic control

Indexed keywords

CONGESTION; CONTROL PERFORMANCE; DUAL HEURISTIC PROGRAMMING; DUAL HEURISTIC PROGRAMMING (DHP); FREEWAY SYSTEMS; FREEWAY TRAFFIC; NEURAL CONTROLLER; NEURAL NETWORK CONTROLLERS; NONRECURRENT CONGESTION; OFFLINE; ONLINE TRAINING; OPTIMAL COORDINATION; RAMP METERING; RAMP METERING ALGORITHMS; REAL-TIME IMPLEMENTATIONS; SIMULATION STUDIES; TRAFFIC MODEL;

CONTROLLERS; HEURISTIC METHODS; HEURISTIC PROGRAMMING; HIGHWAY TRAFFIC CONTROL; NEURAL NETWORKS; REAL TIME CONTROL; TRAFFIC CONTROL;

TRAFFIC CONGESTION;

EID: 82455175244     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2011.2122257     Document Type: Article

References (46)

1. M. Papageorgiou, Application of Automatic Control Concepts to Traffic Flow Modeling and Control. New York: Springer-Verlag, 1983.
2. M. Papageorgiou and A. Kotsialos, "Freeway ramp metering: An overview" IEEE Trans. Intell. Transp. Syst., vol. 3, no. 4, pp. 271-281, Dec. 2002.
3. J. Robinson and M. Doctor, "Ramp metering status in North America" Office Traffic Oper., Fed. Highway Admin., U.S. Dept. Transp., Washington, DC, 1995.
4. R. Wilshire, R. Black, R. Grochoske, and J. Higonbotham, ITE Traffic Control Systems Handbook, Washington, DC, Dec. 1985.
5. M. Papageorgiou, H. Hadj-Salem, and J. M. Blosseville, "ALINEA: A local feedback control law for on-ramp metering" Transp. Res. Rec., no. 1320, pp. 58-64, 1991.
6. N. B. Golstein and K. S. P. Kumar, "A decentralized control strategy for freeway regulation" Transp. Res. Part B, Methodological, vol. 16, no. 4, pp. 279-290, Aug. 1982.
7. M. Papageorgiou, J. M. Blosseville, and H. S. Habib, "Modeling and realtime control of traffic flow on the southern part of Boulevard Peripherique in Paris: Part II: Coordinated on-ramp metering" Transp. Res. Part A, General, vol. 24, no. 5, pp. 361-370, Sep. 1990.
8. M. Papageorgiou, "Multilayer control system design applied to freeway traffic" IEEE Trans. Autom. Control, vol. AC-29, no. 6, pp. 482-490, Jun. 1984.
9. P. Y. Li, R. Horowitz, L. Alvarez, J. Frankel, and A. M. Robertson, "Traffic flow stabilization" in Proc. Amer. Control Conf., Seattle, WA, 1995, pp. 144-149.
10. A. Hegyi, B. D. Schutter, and H. Hellendoorn, "Model predictive control for optimal coordination of ramp metering and variable speed limits" Transp. Res. Part C, Emerging Technol., vol. 13, no. 3, pp. 185-209, Jun. 2005.
11. A. Kotsialos, M. Papageorgiou, M. Mangeas, and H. Salem, "Coordinated and integrated control of motorway networks via non-linear optimal control" Transp. Res. Part C, Emerging Technol., vol. 10, no. 1, pp. 65-84, Feb. 2002.
12. Y. H. Chiang and J. C. Juang, "Control of freeway traffic flow in unstable phase by H8 theory" IEEE Trans. Intell. Transp. Syst., vol. 9, no. 2, pp. 193-208, Jun. 2008.
13. C. Jacob and B. Abdulhai, "Automated adaptive traffic corridor control using reinforcement learning: Approach and case studies" in Proc. 85th Annu. Meeting Transp. Res. Board, 2006, pp. 1-8.
14. A. D. Febbraro, T. Parisini, S. Sacone, and R. Zoppoli, "Neural approximations for feedback optimal control of freeway systems" IEEE Trans. Veh. Technol., vol. 50, no. 1, pp. 302-313, Jan. 2001.
15. H. M. Zhang, S. G. Ritchie, and R. Jayakrishnan, "Coordinated trafficresponsive ramp control via nonlinear state feedback" Transp. Res. Part C, Emerging Technol., vol. 9, no. 5, pp. 337-352, Oct. 2001.
16. P. J.Werbos, "Advanced forecasting methods for global crisis warning and models of intelligence" Gen. Syst. Yearbook, vol. 22, pp. 25-38, 1977.
17. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling" in Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches, D. A. White and D. A. Sofge, Eds. NewYork: Van Nostrand, 1992, ch. 13.
18. R. A. Santiago and P. J. Werbos, "New progress towards truly brain-like intelligent control" in Proc. World Congr. Neural Netw., San Diego, CA, 1994, pp. 27-33.
19. D. V. Prokhorov and D. C. Wunsch, "Adaptive critic designs" IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 997-1007, Sep. 1997.
20. G. G. Lendaris and C. Paintz, "Training strategies for critic and action neural networks in dual heuristic programming method" in Proc. Int. Joint Conf. Neural Netw., Houston, TX, 1997, vol. 2, pp. 712-717.
21. J. Si and Y. T. Wang, "On-line learning control by association and reinforcement" IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 264-276, Mar. 2001.
22. D. Liu, X. Xiong, and Y. Zhang, "Action-dependent adaptive critic designs" in Proc. Int. Joint Conf. Neural Netw., Washington, DC, 2001, vol. 2, pp. 990-995.
23. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive dynamic programming" IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 32, no. 2, pp. 140-153, May 2002.
24. L. Yang, R. Enns, Y. T. Wang, and J. Si, "Direct neural dynamic programming" in Stability and Control of Dynamical SystemsWith Applications, D. Liu and P. J. Antsaklis, Eds. Boston, MA: Birkhaüser, 2003, ch. 10.
25. R. Bellman, Dynamic Programming. Princeton, NJ: Princeton Univ. Press, 1957.
26. R. S. Sutton, "Learning to predict by the methods of temporal differences" Mach. Learn., vol. 3, no. 1, pp. 9-44, Aug. 1988.
27. C. J. C. H. Watkins and P. Dayan, "Q-learning" Mach. Learn., vol. 8, no. 3, pp. 279-292, 1992.
28. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
29. X. R. Bai, D. B. Zhao, and J. Q. Yi, "Ramp metering based on adaptive dynamic programming" in Proc. Int. Joint Conf. Neural Netw., Hong Kong, SAR, 2008, pp. 1847-1852.
30. X. R. Bai, D. B. Zhao, and J. Q. Yi, "Coordinated control of multiple ramps metering based on ADHDP (λ) controller" Int. J. Innov. Comput., Inf. Control, vol. 5, no. 10(B), pp. 3471-3481, 2009.
31. H. J. Payne, "Models of freeway traffic and control" in Proc. Math. Models Public Syst., Simul. Council, 1971, pp. 51-61.
32. M. Cremer and A. D. May, "An Extended Traffic Model for Freeway Control" Inst. Transp. Stud., Univ. California, Berkeley, Res. Rep. UCBITS- RR-85-7, 1985.
33. T. T. Shannon and G. G. Lendaris, "Qualitative models for adaptive critic neurocontrol" in Proc. IEEE Int. Joint Conf. Neural Netw., 1999, vol. 1, pp. 455-460.
34. M. Papageorgiou, C. Diakaki, V. Dinopoulou, A. Kotsialos, and Y. Wang, "Review of road traffic control strategies" Proc. IEEE, vol. 91, no. 12, pp. 2043-2067, Dec. 2003.
35. D. Prokhorov and D. C. Wunsch, "Convergence of critic-based training" in Proc. IEEE Int. Conf. Syst., Man, Cybern., 1997, vol. 4, pp. 3057-3060.
36. D. Prokhorov and L. A. Feldkamp, "Analyzing for Lyapunov stability with adaptive critics" in Proc. IEEE Int. Conf. Syst., Man, Cybern., 1998, vol. 2, pp. 1658-1661.
37. F. -Y. Wang, "OSGi and agent-based technology for control and management of networked applications" in Proc. Chin. Conf. Sci. Tech. Household Electron., Hangzhou, China, 2001, pp. 81-93.
38. F. -Y.Wang and G. N. Saridis, "Suboptimal control for nonlinear stochastic systems" in Proc. 31st IEEE Conf. Decision Control, Tucson, AZ, 1992, pp. 1856-1861.
39. F.-Y. Wang and G. N. Saridis, "On successive approximation of optimal control of stochastic dynamic systems" in Modeling Uncertainty An Examination of Stochastic Theory, Methods, and Applications, M. Dror, P. L. Ecuyer, and F. Szidarovszky, Eds. Boston, MA: Kluwer, 2002.
40. K. Doya, "Reinforcement learning in continuous time and space" Neural Comput., vol. 12, no. 1, pp. 219-245, Jan. 2000.
41. L. C. Baird, "Reinforcement learning with function approximation" in Proc. 12th Int. Conf. Mach. Learn., 1995, pp. 30-37.
42. C. J. Lin and C. T. Lin, "Reinforcement Learning for an ART-based fuzzy adaptive learning control network" IEEE Trans. Neural Netw., vol. 7, no. 3, pp. 709-731, May 1996.
43. T. Bellemans, B. D. Schutter, and B. D. Moor, "Model predictive control for ramp metering of motorway traffic: A case study" Control Eng. Pract., vol. 14, no. 7, pp. 757-767, 2006.
44. M. Papageorgiou, H. Hadj-Salem, and F. Middelham, "ALINEA local ramp metering-Summary of field results" Transp. Res. Rec., no. 1603, pp. 90-98, 1998.
45. A. Kotsialos, M. Papageorgiou, and A. Messmer, "Optimal coordinated and integrated control motorway network traffic control" in Proc. 14th Int. Symp. Transp. Traffic Theory, Jerusalem, Israel, 1999, pp. 621-644.
46. iTRANS Consulting Inc., "Costs of non-recurrent congestion in Canada" Ottawa, ON, Canada, TP 14664E, 2006.