Reinforcement learning in supply chains

International Journal of Neural Systems

Volumn 19, Issue 5, 2009, Pages 331-344

  Valluri, Annapurna ^a   North, Michael J ^b   MacAl, Charles M ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Agent based modeling; Reinforcement learning; Supply chain management

Indexed keywords

AGENT-BASED MODELING; COGNITIVE PSYCHOLOGY; DECISION MAKERS; EFFECTIVE MANAGEMENT; HUMAN BEING; INDEPENDENT AGENTS; LEARNING AGENTS; MULTI-AGENT SETTING; MULTI-STAGE; POTENTIAL MECHANISM; TIME PERIODS;

ARTIFICIAL INTELLIGENCE; EDUCATION; INTELLIGENT AGENTS; LEARNING ALGORITHMS; REINFORCEMENT; REINFORCEMENT LEARNING; SUPPLY CHAIN MANAGEMENT;

SUPPLY CHAINS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; GAME; HUMAN; PROBABILITY; REINFORCEMENT;

ALGORITHMS; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; GAME THEORY; HUMANS; MARKOV CHAINS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; REINFORCEMENT (PSYCHOLOGY);

EID: 71049115473     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065709002063     Document Type: Article

References (48)

1. T. J. Strader, F. Lin and M. J. Shaw, Simulation of order fulfillment in divergent assembly supply chains, Journal of Artificial Societies and Social Simulation 1(2) (1998) [http://jasss.soc.survey.ac.uk/ 1/2/s.html].
2. H. L. Lee and C. Billington, Managing supply chain inventory: Pitfalls and opportunities, Sloan Management Review (Spring) (1993) 65-73.
3. J. Nicolaisen, V. Petrov and L. Tesfatsion, Market power and efficiency in a computational electricity market with discriminatory double-auction pricing, IEEE Transactions on Evolutionary Computation 5(5) (2001) 504-523.
4. M. Allias, Le comportement de l'homme rationnel devant le risqúe: Critique des postulats et axiommes de l'Ecole Americaine [Behavior of rational man in the critique of the postulates of the American School.], Econometrica 21 (1953) 503-546.
5. D. Ellsberg, Risk, ambiguity and the savage axioms, Quarterly Journal of Economics 75 (1961) 643-669.
6. J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior (Princeton, NJ: Princeton University Press, 1944).
7. A. Tversky and D. Kahneman, Judgment under uncertainty: Heuristics and biases, Science 185 (1974) 1124-1131.
8. A. Tversky and D. Kahneman, The framing of decisions and the psychology of choice, Science 211 (1981) 453-458.
9. A. Tversky and D. Kahneman, Advances in prospect theory: Cumulative representation of uncertainty, Journal of Risk and Uncertainty 5 (1992) 297-323.
10. S. J. Leven and D. S. Levine, Multiattribute decision making in context: A dynamic neural network methodology, Cognitive Science 20 (1996) 271-299.
11. H. Simon, Theories of bounded rationality, in Simon H. (ed.), Models of Bounded Rationality. Behavioral Economics and Business Organization (Cambridge, MA: MIT Press, 1982).
12. L. Erev and A. E. Roth, Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria, American Economic Review 88(4) (1998) 848-881.
13. T. Daniel, D. Seale and A. Rapoport, Strategic play and adaptive learning in the sealed bid bargaining mechanism, Journal of Mathematical Psychology 42 (1998) 133-166.
14. D. Monticolov, V. Hilaire, S. Gomes and A. Koukam, A multi-agent system for building project memories to facilitate the design process, Integrated Computer- Aided Engineering 15(1) (2008) 3-20.
15. H. C. Chen, M. Goldberg, M. Magdon-Ismail and W. A. Wallace, Reverse engineering a social agentbased hidden Markov model, International Journal of Neural Systems 18(6) (2008) 491-526.
16. D. Parker, S. Manson, M. Janssen, M. Hoffman and P. Deadman, Multi-agent systems for the simulation of land use and land cover change: A review, Annals of the Association of American Geographers (2003).
17. J. M. Epstein and R. Axtell, Growing Artificial Societies (Cambridge, MA: MIT Press, 1996).
18. C. Fang, S. O. Kimbrough, S. Pace, A. Valluri and Z. Zheng, On adaptive emergence of trust behavior in the game of Stag Hunt, Group Decision and Negotiation 11(6) (2002) 449-467.
19. M. J. North and C. M. Macal, Managing Business Complexity: Discovering Strategic Solutions with Agent-based Modeling and Simulation (Oxford, USA, 2007).
20. N. Gilbert and K. G. Troitzsch, Simulation for the Social Scientist (Buckingham, UK and Philadelphia, PA: Open University Press, 1999).
21. H. V. D. Parunak, R. Savit and R. L. Riolo, Agentbased modeling vs. equation-based modeling: A case study and users' guide, Proceedings of Multi-agent systems and Agent-based Simulation (1998).
22. J. D. Sterman, Modeling managerial behavior: Misperceptions of feedback in a dynamic decision making experiment, Management Science 35(3) (1989) 21-339.
23. H. L. Lee, V. Padmanabhan and S. Whang, The Bullwhip Effect in supply chains, Sloan Management Review (1997) 93-102.
24. S. O. Kimbrough, D. J. Wu and F. Zhong, Computers play the Beer Game: Can artificial agents manage supply chains, Decision Support Systems 33(3) (2002) 323-333.
25. S. K. Chaharsooghi, J. Heydari and H. Zegordi, A reinforcement learning model for supply chain ordering management: An application to the Beer Game, Decision Support Systems 45 (2008) 949-959.
26. T. van Tongeren, U. Kaymak, D. Naso and E. van Asperen, Q-Learning in a competitive supply chain, IEEE 2007 International Conference on Systems, Man and Cybernetics (Montreal, Que.) (2007) 1211-1216.
27. G. Zhao, and R. Sun, Policy transition of reinforcement learning for an agent based SCM system," 2006 IEEE International Conference on Industrial Informatics, Singapore (2006).
28. I. Giannoccaro and P. Pontrandolfo, Inventory management in supply chains: A reinforcement learning approach, International Journal of Production Economics 78 (2002) 153-161. (Pubitemid 34532511)
29. H. V. D. Parunak, R. Savit, R. L. Riolo and S. J. Clark, DASCh: Dynamics analysis of supply chains, Executive Report (Center for Electronic Commerce, ERIM, 1999).
30. M. J. North and C. M. Macal, The beer dock: Three and a half implementations of the Beer Distribution Game SwarmFest 2002 Proceedings (Swarm Development Group, Seattle, WA USA, 2002), p. 17.
31. M. S. Fox, M. Barbuceanu and R. Teigen, Agentoriented supply-chain management, International Journal of Flexible Manufacturing Systems 12 (2000) 165-188.
32. R. S. Sutton and A. G. Barto, Toward a modern theory of adaptive networks: Expectation and prediction, Psychological Review 88 (1981) 135-140.
33. R. S. Sutton and A. G. Barto, A temporal-difference model of classical conditioning, Proceedings of the Ninth Annual Conference of the Cognitive Science Society (1987) 355-378.
34. R. S. Sutton and A. G. Barto, Reinforcement Learning (Cambridge, MA: MIT Press, 1998).
35. C. Watkins, Learning from Delayed Rewards (PhD Thesis King's College, Oxford, 1989).
36. R. D. Cyert and J. G. March, A Behavioral Theory of the Firm (Englewood Cliffs, N.J.: Prentice-Hall, 1963).
37. J. March, Exploration and exploitation in organizational learning, Organization Science 2(1) (1991).
38. R. S. Sutton, Generalization in reinforcement learning: Successful examples using sparse coarse coding, Advances in Neural Information Processing Systems (1996).
39. L. Baird, Residual Algorithms: Reinforcement learning with function approximation, in Proceedings of the International Conference on Machine Learning (1995).
40. J. C. Santamaria, R. S. Sutton and A. Ram, Experiments with reinforcement learning in problems with continuous state and action spaces, Adaptive Behavior 6(2) (1998) 163-218. (Pubitemid 128049217)
41. L. Baird and H. Klopf, Reinforcement learning with high-dimensional, continuous actions, Technical Report WL-TR-93-1147 (Wright Laboratory, 1993).
42. G. Tesauro, Practical issues in temporal difference learning, Machine Learning 8 (1992) 257-277.
43. G. Tesauro, TD-Gammon, a self-teaching backgammon program achieves master-level play, Neural Computation 6 (1994) 215-219.
44. G. Tesauro, Temporal difference learning and TDGammon, Communications of the ACM9 38 (1995) 58-68.
45. F. Gibson, M. Fichman and D. C. Plaut, Learning in dynamic decision tasks: Computational model and empirical evidence, Organizational Behavior and Human Decision Processes 71(1) (1997) 1-35.
46. ROAD: Repast Organization for Architecture and Design Home Page, Available at http://repast. sourceforge.net/ (2009).
47. P. Stone and R. S. Sutton, Scaling reinforcement learning toward Robocup soccer, Proceedings of the Eighteenth International Conference on Machine Learning, (Williams College: Morgan Kaufman, 2001), pp. 537-1534
48. S. Thrun and A. Schwartz, Issues in using function approximation for reinforcement learning, Proceedings of the Fourth Connectionist Models Summer School (Hillsdale, NJ: Lawrence Erlbaum Publisher, 1993).