Validating agent based social systems models

Proceedings - Winter Simulation Conference

Volumn , Issue , 2010, Pages 441-453

  Bharathy, Gnana K ^a   Silverman, Barry ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGENT BASED; COUNTERFACTUALS; FEATURE SPACE; FORMAL VALIDATION; MULTIPLE LEVELS; NEWS FEEDS; SOCIAL SYSTEMS; VALIDITY ASSESSMENT;

EID: 79951604804     PISSN: 08917736     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WSC.2010.5679142     Document Type: Conference Paper

References (37)

1. Axtell, R., Axelrod, R., Epstein J., and Cohen, M. D. 1996. "Aligning Simulation Models: A Case Study and Results," Computational and Mathematical Organization Theory, Vol. 1, No. 1, pp. 123-141.
2. Baker, P. H. 2003. "Conflict Resolution: A Methodology for Assessing Internal Collapse and Recovery," by in Armed Conflict in Africa, Carolyn Pumphrey and Rye Schwartz-Barcott, eds. (Triangle Institute for Strategic Studies, Lanham, MD and Oxford: The Scarecrow Press, 2003).
3. Balci, O. 1998. "Verification, Validation, and Testing", In The Handbook of Simulation, J. Banks, Editor, John Wiley & Sons, New York, NY, August, Chapter 10, pp. 335-393.
4. Banks, J., J. S. Carson, B. L. Nelson, and D. M. Nicol. 2000. Discrete-event system simulation. 3rd ed. Upper Saddle River, New Jersey: Prentice-Hall, Inc.
5. Barreteau, O., and others 2003. Our companion modelling approach, Journal of Artificial Societies and Social Simulation, 6(1), 〈http://jasss.soc. surrey.ac.uk/6/2/1.html〉 [accessed 2006/07/30]
6. Carley, K. M. and Gasser, L. 1999. "Computational and Organization Theory," in Weiss, G. (Ed.), Multiagent Systems - Modern Approach to Distributed Artificial Intelligence, MIT Press, pp. 299-330.
7. Covey, Jock, Michael Dziedzic, and Leonard Hawley, Editors, The Quest for Viable Peace: International Intervention and Strategies for Conflict Transformation, United States Institute of Peace, Washington DC, 2005; http://bookstore.usip.org/books/BookDetail.aspx?productID=120589.
8. De Marchi, S. 2005. Computational and Mathematical Modeling in the Social Sciences, Cambridge
9. Dziedzic, M., Sotirin, B., and J. Agoglia, Editors, Measuring Progress in conflict Environments (MPICE) - A Metrics Framework for Assessing Conflict Transformation and Stabilization," Defense Technical Information Catalog, Aug 2008; or United States Institute of Peace.
10. Edmonds, B. and S.J. Moss 2004. From Kiss to KIDS - an 'antisimplistic' modelling approach; in: P. Davidsson et al. (eds.): Multi Agent Based Simulation; Springer, Lecture Notes in Artificial Intelligence, 3415: p.130-144. http://bruce.edmonds.name/kiss2kids/kiss2kids.pdf, (accessed 2006/07/30).
11. Edmonds, B. and Chattoe, E. 2005. When Simple Measures Fail: Characterising Social Networks Using Simulation. Social Network Analysis: Advances and Empirical Applications Forum, Oxford.
12. Fagiolo, G., Windrum, P., and Moneta, A. 2006. Empirical validation of agent based models: a critical survey, LEM Working Paper 2006/14, Sant'Anna School of Advanced Studies, Pisa, Italy, May. http://www.lem.sssup.it/WPLem/ files/2006-14.pdf (accessed 2008/06/15)
13. Gilbert, N. 2004. "Open problems in using agent-based models in industrial and labor dynamics," In R. Leombruni and M. Richiardi (Eds.), Industry and Labor Dynamics: the agent-based computational approach, World Scientific, pp. 401-405.
14. Gluck, K., Bello, P. and Busemeyer, J. 2008. Introduction to the Special Issue [on model comparison]. Cognitive Science 32(8):1245-1424.
15. Goutte, C. 1997. Note on free lunches and cross-validation, Neural Computation, 9, 1211-1215 ftp://eivind.imm.dtu.dk/dist/1997/goutte.nflcv.ps.gz (accessed 2009/04/20)
16. Hartley, D.S. 1997. Verification and Validation in Military Simulation. In Proceedings of the 1997 Winter Simulation Conference, eds. S.G. Henderson, B. Biller, M. Hsieh, J. Shortle, J. D. Tew, R. R. Barton, . Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
17. Hales, D., Rouchier J., and Edmonds, B. 2003. "Model-to-Model Analysis," J. of Artificial Societies and Social Simulation, Vol. 6, No. 4, 5 http://jasss.soc.surrey.ac.uk/6/4/5.html (accessed 2009/06/22)
18. Harré, Rom 1970. The Principles of Scientific Thinking. London: Macmillan.
19. Kahneman, D. and Tversky, A. 1984. Choices, Values and Frames, American Psychologist, Vol. 39, No. 4: 341-50.
20. Leombruni, R., Richiardi, M., Saam, N.J., and Sonnessa, M. 2006. A common protocol for agent-based social simulation, Journal of Artificial Societies and Social Simulation, 9(1). http://jasss.soc.surrey.ac.uk/9/1/15.html (Accessed 2009/09/22)
21. Midgley, D.F., Marks, R.E., and Kunchamwar, D. 2007. The building and assurance of agent-based models: an example and challenge to the field, Journal of Business Research, 60: 884-893. At: http://www.agsm.edu.au/~bobm/papers/ Midgley-Marks-Kunchamwar.pdf (Accessed 2010/03/08)
22. Murphy, A.H., 1993: What is a good forecast? An essay on the nature of goodness in weather forecasting. Weather Forecasting, 8, 281-293
23. Modeling and Simulation Coordination Office. Verification, Validation, and Accreditation (VV&A) Recommended Practice Guide. September 15, 2006. At: http://vva.msco.mil. (Accessed June 10. 2010).
24. Moss, S. and Davidsson, P. 2001, Multi-Agent-Based Simulation, Lecture Notes in Artificial Intelligence, Vol. 1979, Springer-Verlag.
25. Moss, S. and B. Edmonds 2005. Sociology and Simulation: Statistical and Qualitative Cross-Validation. Manchester, American Journal of Sociology 110(4): 1095-1131. (Pubitemid 40912149)
26. Pahl-Wöstl, C. 1995. The dynamic natural of ecosystems: Chaos and order entwined. Chichester: Wiley.
27. Schreiber, D. 2002. Validating agent-based models: From metaphysics to applications. Annual Conference of the Midwestern Political Science Association, Chicago, IL: April 2002.
28. Silverman, B.G., 2010. Systems social science: a design inquiry approach for stabilization and reconstruction of social systems, J. of Intelligent Decision Technologies. 4 (1): 51-74
29. Silverman, B.G. Bharathy, G.K., and G. J. Kim 2009a, "The New Frontier of Agent-Based Modeling and Simulation of Social Systems with Country Databases, Newsfeeds, and Expert Surveys " in Agents, Simulation and Applications, A. Uhrmacher and D. Weyns, (eds.) Taylor and Francis.
30. Silverman, B., Bharathy, G., and B. Nye 2009b, " Gaming and Simulating Sub-National Conflicts ", In Computational Methods for Counter-Terrorism, Shlomo Argamon and Newton Howard (ed.) Springer- Verlag (Berlin, Hiedelberg and New York).
31. Silverman, BG., Bharathy, GK, Nye, B., Kim, G. J., Roddy, Poe, M. 2010. "Simulating State and Sub- State Actors with CountrySim: Synthesizing Theories across the Social Sciences", In Sokolowski, J. and Banks. C. (ed.): Modeling and Simulation Fundamentals: Theoretical Underpinnings and Practical Domains, M. Wiley STM
32. Silverman, B.G., Bharathy, G.K., Eidelson, R. and B. Nye 2007a. "Modeling Factions for 'Effects Based Operations': Part I -Leaders and Followers ", Journal of Computational and Mathematical Organization Theory. 13:379-406.
33. Silverman, B.G., Bharathy, G.K., Nye B. and T. Smith 2008a. "Modeling Factions for 'Effects Based Operations': Part II - Behavioral Game Theory ", Journal of Computational and Mathematical Organization Theory, 14(2):120-155, 2008.
34. Silverman, B.G., Bharathy, G.K., Smith, T. and Eidelson, R., and M. Johns 2007b. " Socio-Cultural Games for Training and Analysis: The Evolution of Dangerous Ideas ", IEEE Systems, Man and Cybernetics. Nov 2007. 37:6: 1113-1130, 2007.
35. Silverman, B. G., and G. K. Bharathy. 2005. "Modeling the Personality & Cognition of Leaders," in 14th Conference on Behavioral Representations In Modeling and Simulation, SISO, May.
36. Tetlock, P. 2005. Expert Political Judgment: How Good is It? How Can We Know?, Princeton, NJ: Princeton University Press.
37. WCRP 2009. Forecast Verification - Issues, Methods and FAQ, World Climate Research Programme, World Meteorological Organization. WWRP/WGNE, WG on Verification (accessed 2010/06/22), http://www.bom.gov.au/bmrc/wefor/staff/eee/ verif/verif-web-page.html