A Q-learning system for container transfer scheduling based on shipping order at container terminals

International Journal of Innovative Computing, Information and Control

Volumn 4, Issue 3, 2008, Pages 547-558

  Hlrashima, Yoichi ^a  

^a OSAKA INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Block stacking; Container transfer problem; Dynamic programming; Learning; Multi objective optimization; Q learning; Reinforcement learning; Scheduling

Indexed keywords

EID: 63649153086     PISSN: 13494198     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (12)

1. L. M. Gambardella, M. Mastrolilli, A. E. Rizzoli and M. Zaffalon, An optimization methodology for intermodal terminal management, Journal of Intelligent Manufacturing, vol.12, no.5/6, pp.521-534, 2001.
2. Y. G. Chung, S. U. Randhawa and E. D. McDowell, A simulation analysis for a transtainer based container handling facility, Computers and Industry Eng., vol.14, no.2, pp.113-125, 1988.
3. M. B. Siberholz, B. L. Golden and K. Baker, Using simulation to study the impact of work rules on productivity at marine container terminals, Computers Oper. Res., vol.18, no.5, pp.433-452, 1991.
4. D. Steenken, S. Voß and R. Stahlbock, Container terminal operation and operations research - A classification and literature review, OR Spectrum, vol.26, no.l, pp.3-46, 2004.
5. S. Hartmann, A general framework for scheduling equipment and manpower at container terminals, OR Spectrum, vol.26, no.l, pp.51-74, 2004.
6. J. R. Koza, Genetic Programming : On Programming Computers by Means of Natural Selection and Genetics, MIT Press, 1992.
7. S. Hartmann, Generating scenarios for simulation and optimization of container terminal logistics, OR Spectrum, vol.26, no.2, pp.171-192, 2004.
8. S. Hartmann, H. Hama, M. Minagawa and Y. Kakazu, A distributed approach to block stacking problem based on evolutionary learning, Trans. Japan. Soc. Mechanical Eng., vol.C-62, no.597, pp.232-239, 1996 (in Japanese).
9. E. B. Baum, Toward a model of intelligence as an economy of agents, Machine Learning, vol.35, pp.155-185, 1999.
10. Y. Hirashima, K. Takeda and A. Inoue, A Q-learning system for material handling operation in container terminal, Proc. of the 2002 Japan-USA Symposium on Flexible Automation, pp. 1091-1094, 2002.
11. C. J. C. H. Watkins and P. Dayan, Q-learning, Machine Learning, vol.8, pp.279-292, 1992.
12. M. L. Littman and C. Szepesvári, A generalized reinforcement-learning model: Convergence and applications, Proc. of the 13th International Conf, on Machine Learning, pp.310-318, 1996