Q value-based Dynamic Programming with SARSA Learning for real time route guidance in large scale road networks

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2012, Pages

  Yu, Shanqing ^a   Zhou, Jing ^a   Li, Bing ^a   Mabu, Shingo ^a   Hirasawa, Kotaro ^a  

^a WASEDA UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION TIME; CONVENTIONAL METHODS; DISTRIBUTED DYNAMICS; DYNAMIC ROUTES; REAL TIME; REAL WORLD ROAD NETWORKS; REAL-TIME TRAFFIC INFORMATION; ROAD NETWORK; ROUTE GUIDANCE; SARSA LEARNING; TRAFFIC MANAGEMENT; TRAFFIC SYSTEMS; TRAVELING TIME; VALUE-BASED;

DYNAMIC PROGRAMMING; MANAGEMENT; MOTOR TRANSPORTATION; NEURAL NETWORKS; TRAFFIC CONGESTION;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84865138132     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2012.6252507     Document Type: Conference Paper

References (21)

1. M. A. P. Taylor, J. E. Woolley and R. Zito, "Integration of the global positioning system and geographical information systems for traffic congestion studies" Transportation Research Part C: Emerging Technologies, vol.8, pp.257 - 285, 2000.
2. B. J. Kanninen, "Intelligent transportation systems : an economic and environmental policy assessment", Transportation Reseach, Vol. 30A (I), pp. 1-10, 1996.
3. T. Shiose, T. Sawaragi and O. Katai, "Multiagent Model of V ICS", In Proc. of the IEEE SMC Conference, Vol. 4, pp. 574-579, 1999.
4. J. H. Rillings and J. W. Lewis: TravTek, In Proc. of the Vehicle Navigation and Information Systems Conference, Vol. 2, pp. 20-23, 1991.
5. E. Dijkstra: A Note on Two Problems in Connection with Graphs, Numerische Mathematik, Vol. 1, pp. 269-271, 1959.
6. G. R. Jagadeesh, T. Srikanthan and K. H. Quek: Heuristic Techniques for Accelerating Hierarchical Routing on Road Networks, IEEE Transactions on Intelligent Transportation Systems, Vol. 3, No. 4, pp. 301-309, Dec. 2002.
7. E. P. Hart, N. J. Nilsson and B. Raphael: A formal basis for the heuristic determination of minimum cost paths, IEEE Trans. Syst. Sci. Cybern.,Vol. SSC-4, No. 2, pp. 100-107, Jul. 1968.
8. M. K. Mainali, K. Shimada, S. Mabu and K. Hirasawa: Optimal Route Based on Dynamic Programming for Road Networks, Journal of Advanced Computational Intelligence and Intelligent Informatics, Vol. 12 No.4, pp. 546-553, 2008.
9. G. A. Rummery and M. Niranjan, "Online Q learning using connectionist systems", Tech. rep. CUEDIFINFENGfFR 166, Cambridge University Engineering Department, Cambridge, England, 1994.
10. Sutton, R.S, " Generalization in Reinforcement Learning: Succssful Examples Using Sparse Coarse Coding", Advances in Neural Information Processing Systems 8, pp. 1038-1044, MIT Press, 1996.
11. Baird, L, and A. Moore, " Gradient Descent for General Reinforcement Learning", Advances in Neural Information Processing Systems 11, pp. 968-974, MIT Press, 1998.
12. I-Transport Lab. CO.,Ltd. Available: http://www.i-transportlab .jp/products/sound/
13. D. Eppstein: Finding the K shortest paths, SIAM J. Comput., Vol. 28, No. 2, pp. 652-673, 1998.
14. E. Q. V. Martins, M. M. B. Pascoal and J. L. E. Santos: Deviation algorithms for ranking shortest paths, Int. J. Found. Comput. Sci., Vol. 10, No. 3, pp. 247-261, 1999.
15. D. Torrieri: Algorithms for finding an optimal set of short disjoint paths in a communication network, IEEE Trans. Commun., Vol. 40, No. 1 1, pp. 1698-1702, Nov. 1992.
16. Y. Chen, M. G. H. Bell and K. Bogenberger: Reliable Pretrip Multipath Planning and Dynamic Adaptation for a Centralized Road Navigation System, IEEE Trans. ITS, Vol. 8, No. 1, pp. 14-20, 2007.
17. N. Jing, Y. Huang and E. Rundensteiner: Hierarchical optimization of optimal path finding for transportation applications, In Proc. of the fifth international conference on Iriformation and knowledge management, pp. 26 1-268, 1996.
18. N. Jing, Y. Huang and E. Rundensteiner: Hierarchical Encoded Path Views for Path Query Processing: An Optimal Model and Its Performance Evaluation, IEEE Trans. on Knowledge and Data Engineering, Vol. 10, No. 3, pp. 409-432, 1998.
19. S. lung and S. Pramanik: An Efficient Path Computation Model for Hierarchically Structured Topographical Road Maps", IEEE Trans. on Knowledge and Data Engineering, Vol. 14, No. 5, pp. 1029-1046, 2002.
20. F. Wen, M. Gen and X. Yu: Multilayer Traffic Network Optimized by Multiobjective Genetic Clustering Algorithm, IEICE Trans. F undamentals, Vol. E92-A, No. 8, pp. 2107-2115, 2009
21. Z. Zhang and J. Xu, "A dynamic route guidance arithmetic based on reinforcement learning", In Proc. of the Fourth International Coriference on Machine Learning and Cybernetics, vol.6, pp.3607-36 11,Guangzhou, China, 2005.