Effectiveness of Q-learning as a tool for calibrating agent-based supply network models

Enterprise Information Systems

Volumn 1, Issue 2, 2007, Pages 217-233

  Zhang, Y ^a   Bhattacharyya, S ^b  

^a UNIVERSITY OF ILLINOIS AT SPRINGFIELD   (United States)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

Agent based modelling; Computational techniques; Distributed artificial intelligence (DAI); Q learning; Supply chain management (SCM)

Indexed keywords

EID: 84962883952     PISSN: 17517575     EISSN: 17517583     Source Type: Journal    
DOI: 10.1080/17517570701275390     Document Type: Article

References (18)

1. Axtell, R. 2000. “ Why agents? On the varied motivations for agent computating in the social sciences ”. In Working Paper No. 17, The Brookings Institute, Centre on Social and Economic Dynamics.
2. Beamon, BM, and Chen, VCP. 2001. Performance analysis of conjoined supply chains. Int. J. Prod. Res., 39 (14):3195–3218.
3. Bernstein, F, and Federgruen, A. 2003. Pricing and replenishment strategies in a distribution system with competing retailers. Op. Res., 51 (3):409–426.
4. Clark, AJ, and Scarf, H. 1960. Optimal policies for a multi-echelon inventory problem. Manage. Sci., 6:475–490.
5. Dimicco, JM, Maes, P, and Greenwald, A. 2003. Learning curve:A simulation-based approach to dynamic pricing. Electron. Comm. Res., 3:245–276.
6. Greenwald, A, Kephart, JO, and Tesauro, GJ. 1999. Strategic pricebot dynamics. Proceedings of the First ACM Conference on Electronic Commerce. 1999.
7. Kutschinskia, E, Uthmannb, T, and Polanic, D. 2003. Learning competitive pricing strategies by multi-agent reinforcement learning. J. Econ. Dynam. & Cont., 27:2207–2218.
8. Lin, FR, Strader, TJ, and Shaw, MJ. 2000. “ Using swarm for simulating the order fulfillment process in divergent assembly supply chains ”. In Economic Simulations in Swarm:Agent-Based Modelling and Object Oriented Programming, Edited by:Luna, F., and Stefansson, B., 225–249. Boston, MA:Kluwer Academic Publishers.
9. Luo, J, Xu, L, Jamont, JP, Zeng, L, and Shi, Z. 2007. Flood decision support system on agent grid:method and implementation. Ent. Inform. Syst., 1 (1):49–68.
10. Malone, T, Yates, J, and Benjamin, R. 1987. Electronic markets and electronic hierarchies:effects of information technology on market structure and corporate strategies. Comm. ACM, 30 (6):484–497.
11. North, MJ, and Macal, CM. 2002. “ The beer dock:three and a half implementations of the beer distribution game ”. Unpublished manuscript
12. Parunak, HVD, Savit, R, Riolo, RL, and Clark, SJ. 1999. DASCh:Dynamic Analysis of Supply Chains, Ann Arbor, MI:Centre for Electronic Commerce, ERIM, Inc. Also available online at:http://www.newvectors.net/staff/parunakv/dasch99.pdf (accessed April 2007)
13. Schlueter Langdon, C, Bruhn, P, and Shaw, MJ. 2000. “ Online supply chain modelling and simulation ”. In Economic Simulations in Swarm:Agent-Based Modelling and Object Oriented Programming, Edited by:Luna, F., and Stefanssonb, B., 251–272. Boston, MA:Kluwer Academic Publishers.
14. Tesauro, GJ, and Kephart, JO. 2002. Pricing in agent economies using multi-agent Q-learning. Auton. Agents & Multi-agent Syst., 5:289–304.
15. Wang, S, and Archer, N. 2007. Electronic marketplace definition and classification:Literature review and clarifications. Ent. Inform. Syst., 1 (1):89–112.
16. Watkins, C. 1989. “ Learning from delayed rewards ”. In PhD thesis, King's College.
17. Wilke, J. 2002. “ Using agent-based simulation to analyze supply chain value and performance ”. In Supply Chain World Conference and Exposition
18. Zhang, Y, and Bhattacharyya, S. 2004. Learning to order in supply networks:an agent modelling study. Agent 2004 Conference. 2004. pp. 703–715.