Evaluating the educational effectiveness of simulation games: A value generation model

Information Sciences

Volumn 264, Issue , 2014, Pages 75-90

  Ranchhod, Ashok ^a   Gurǎu, Cǎlin ^b   Loukis, Euripides ^c   Trivedi, Rohit ^d  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b MONTPELLIER BUSINESS SCHOOL   (France)

^c UNIVERSITY OF THE AEGEAN   (Greece)

^d MICA   (India)

Author keywords

Marketing management education; Markstrat; Model development and validation; Simulation games; Value generation

Indexed keywords

EID: 84894463383     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2013.09.008     Document Type: Article

References (97)

1. H.S. Adelman Intervention theory and evaluating efficacy Evaluation Review 10 1 1986 65 83
2. C. Aldrich, Learning by Doing: A Comprehensive Guide to Simulations, Computer Games, and Pedagogy in e-Learning and other Educational Experiences, Pfeiffer, San Francisco, CA, 2005.
3. P.H. Anderson, and L. Lawton Business simulations and cognitive learning: developments, desires and future directions Simulation & Gaming 40 2 2009 193 216
4. R.P. Bagozzi, and Y. Yi On the evaluation of structural equation models Journal of the Academy of Marketing Science 16 1 1988 74 94
5. R.P. Bagozzi, Y. Yi, and L.W. Phillips Assessing construct validity in organizational research Administrative Science Quarterly 36 3 1991 421 458
6. A.J. Baroody The development of adaptive expertise and flexibility: the integration of conceptual and procedural knowledge A.J. Baroody, A. Dowker, The Development of Arithmetic Concepts and Skills: Constructing Adaptive Expertise 2003 Lawrence Erlbaum Mahwah, NJ 1 34
7. M. Begum, and R. Newman Evaluation of students' experiences of developing transferable skills and business skills using a business simulation game Proceedings of the 39th IEEE International Conference on Frontiers in Education Conference 2009 IEEE Press Piscataway, NJ 92 97
8. F. Bellotti, B. Kapralos, K. Lee, P. Moreno-Ger, and R. Berta Assessment in and of serious games: an overview Advances in Human-Computer Interaction 2013 1 11
9. B.S. Bloom, N.D. Englehart, E.J. Furst, W.H. Hill, D.R. Krathwohl, Taxonomy of Educational Objectives: The Classification of Educational Goals, Handbook I: Cognitive Domain, David McKay, New York, NY, 1956.
10. J.D. Bransford, A.L. Brown, and R.R. Cocking How People Learn 1999 National Academy Press Washington, DC
11. R. Brennan, L. Vos, R. Willetts, Student Experiences of the use of a Marketing Simulation Game. Middlesex University Business School Discussion Paper, London, UK, 2008. (accessed 06.11).
12. M.W. Browne, and R. Cudeck Alternative ways of assessing model fit K.A. Bollen, S.J. Long, Testing Structural Equation Models 1993 Sage Newbury Park, CA 136 162
13. E. Castronova Synthetic Worlds: The Business and Culture of Online Games 2005 University of Chicago Press London, UK
14. J. Chin, R. Dukes, and W. Gamson Assessment in simulation and gaming: a review of the last 40 years Simulation & Gaming 40 4 2009 553 568
15. J. Cioffi, N. Purcal, and F. Arundell A pilot study to investigate the effect of a simulation strategy on the clinical decision making of midwifery students Journal of Nursing Education 44 3 2005 131 134
16. T.M. Connolly, E.A. Boyle, E. MacArthur, T. Hainey, and J.M. Boyle A systematic literature review of empirical evidence on computer games and serious games Computers and Education 59 2 2012 661 686
17. J. Cohen Statistical Power Analysis for the Behavioral Sciences second ed. 1988 Lawrence Erlbaum Associates Hillsdale, NJ
18. R.W. Cook, and C.O. Swift The pedagogical efficacy of sales management simulation Marketing Education Review 16 3 2006 37 46
19. K.S. Dabbour Applying active learning methods to the design of library instruction for a freshman seminar College & Research Libraries 58 4 1997 299 308
20. T.J. Fenwick, Experiential Learning: A Theoretical Critique Explored Through Five Perspectives, Information Series No. 385, ERIC Clearinghouse on Adult, Career, and Vocational Education, Columbus, OH, 2001.
21. T.J. Fenwick Learning through Experience: Troubling Orthodoxies and Intersecting Questions 2003 Krieger Publishing Malabar, FL
22. S. de Freitas Using games and simulations for supporting learning Learning, Media and Technology 31 4 2006 343 358
23. S. de Freitas, and G. Conole The influence of pervasive and integrative tools on learners' experiences and expectations of study R. Sharpe, H. Beetham, S. de Freitas, Rethinking Learning for a Digital Age 2010 Routledge London, UK 15 30
24. S. de Freitas, and P. Maharg Introduction: digital games and learning S. de Freitas, P. Maharg, Digital Games and Learning 2011 Continuum Press London, UK 1 16
25. S. de Freitas, and T. Neumann The use of 'exploratory learning' for supporting immersive learning in virtual environments Computers and Education 52 2 2009 343 352
26. S. de Freitas, and M. Oliver How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? Computers & Education 46 3 2006 249 264
27. C.A. Estes Promoting student-centered learning in experiential education The Journal of Experiential Education 27 2 2004 141 160
28. A.J. Faria, History, current usage, and learning from marketing simulation games: a detailed literature review, in: J. Cherry (Ed.), Marketing Management Association 2006 Educators' Conference Proceedings, September 20-22, Nashville, TN, 2006, pp. pp. 138-139. < http://www.mmaglobal.org/ publications/ProceedingsArchive/2006-FALL-MMA.pdf > (accessed 01.10).
29. A.J. Faria, D. Hutchinson, W.J. Wellington, and S. Gold Developments in business gaming: a review of the past 40 years Simulation and Gaming 40 4 2009 464 487
30. A.H. Feinstein, and H.M. Cannon Constructs of simulation evaluation Simulation & Gaming 33 4 2002 425 440
31. C. Fornell, and D.F. Larcker Evaluating structural equation models with unobservable variables and measurement error Journal of Marketing Research 18 1 1981 39 50
32. R. Garris, R. Ahlers, and J.E. Driskell Games, motivation, and learning: a research and practice model Simulation & Gaming 33 4 2002 441 467
33. H. Gatignon Strategic studies in Markstrat Journal of Business Research 15 6 1987 469 480
34. H. Gatignon, Introducing Markstrat3, 2009. < http://www.insead.edu/ facultyresearch/faculty/personal/hgatignon/teaching/markstrat.cfm > (accessed 11.11).
35. D.W. Gerbing, and J.C. Anderson An updated paradigm for scale development incorporating unidimensionality and its assessment Journal of Marketing Research 25 2 1988 186 192
36. D. Goldenberg, M. Andrusyszyn, and C. Iwasiw The effect of classroom simulation on nursing students' self-efficacy related to health teaching Journal of Nursing Education 44 7 2005 310 314
37. J. Gosen, and J. Washbush A review of scholarship on assessing experiential learning effectiveness Simulation & Gaming 35 2 2004 270 293
38. J. Gosenpud Evaluation of experiential learning J.W. Gentry, Guide to Business Gaming and Experiential Learning 1990 Nichols/GP Publishing New York, NY 301 329
39. D.M. Gray The application of self-directed learning in a marketing strategy capstone course International Journal of Learning and Change 5 3-4 2011 271 287
40. A.R. Gray, K.J. Topping, and W.B. Carcary Individual and group learning of the highway code: comparing board game and traditional methods Educational Research 40 1 1998 45 53
41. J.F. Hair Jr., R.E. Anderson, R.L. Tatham, and W.C. Black Multivariate Data Analysis with Readings fifth ed. 1998 Prentice-Hall Englewood Cliffs, NJ
42. G. Hatano Cognitive consequences of practice in culture specific procedural skills Quarterly Newsletter of the Laboratory of Comparative Human Cognition 4 1 1982 15 18
43. G. Hatano, and K. Inagaki Two courses of expertise H. Stevenson, H. Azuma, K. Hakuta, Child Development and Education in Japan 1986 Freeman New York, NY 263 272
44. K.J. Holyoak Symbolic connectionism: toward third-generation theories of expertise K.A. Erricsson, J. Smith, Toward a General Theory of Expertise: Prospects and Limits 1991 Cambridge University Press New York, NY 301 335
45. J.D. Hoover, and C.J. Whitehead An experiential-cognitive methodology in the first course in management: some preliminary results Simulation Games and Experiential Learning in Action 2 1975 25 30
46. T. Hyland Experiential learning, competence and critical practice in higher education Studies in Higher Education 19 3 1994 327 339
47. H. Jenkins Getting into the game Educational Leadership 62 7 2005 48 51
48. D. Jennings Strategic management: an evaluation of the use of three learning methods Journal of Management Development 21 9 2002 655 665
49. L. Johnson, R. Smith, H. Willis, A. Levine, K. Haywood, The 2011 Horizon Report, The New Media Consortium, Austin, Texas, TX, 2011. < http://net.educause.edu/ir/library/pdf/HR2011.pdf > (accessed 02.12).
50. K.G. Jöreskog, and D. Sörbom LISREL 8: Structural Equation Modelling with the SIMPLIS Command Language 1993 Scientific Software International Chicago, IL
51. F. Ke, A qualitative meta-analysis of computer games as learning tools, in: R.E. Ferdig (Ed.), Handbook of Research on Effective Electronic Gaming in Education, Information Science Reference, Hershey, UK, 2009, pp. 1-32.
52. B. Keys, and J. Wolfe The role of management games and simulations in education and research Journal of Management 16 2 1990 307 336
53. J. Kirriemur, C.A. McFarlane, Literature Review in Games and Learning, 2004. < http://www.futurelab.org.uk/resources/documents/lit-reviews/Games- Review.pdf > (accessed 07.12).
54. K. Klassen, and K. Willoughby In-class simulation games: assessing student learning Journal of Information Technology Education 2 2003 1 13
55. R.B. Kline Principles and Practice of Structural Equation Modeling third ed. 2010 Guilford Press New York, NY
56. D.A. Kolb Experiential Learning 1984 Prentice Hall Englewood Cliffs, NJ
57. D.A. Kolb, and R. Fry Toward an applied theory of experiential learning C. Cooper, Theories of Group Process 1975 John Wiley & Sons London, UK 33 58
58. L.M. Lamont Enhancing student and team learning with interactive marketing simulations Marketing Education Review 11 1 2001 45 55
59. J.-C. Larréché, H. Gatignon, R. Triolet, Markstrat Participant Handbook, StratX International, Cambridge, MA, 2010.
60. D.A. Laverie In-class active cooperative learning: a way to build knowledge and skills in marketing courses Marketing Education Review 16 2 2006 59 76
61. J. Lee Effectiveness of computer-based instructional simulation: a meta-analysis International Journal of Instructional Media 26 1 1999 71 85
62. Y.-L. Lin, and Y.-Z. Tu The values of college students in business simulation game: a means-end chain approach Computers & Education 58 4 2012 1160 1170
63. C.A. Lindley, Trans-Reality Gaming, 2004. < http://www.citeseerx.ist. psu.edu/viewdoc/download?doi=10.1.1.129.4374&rep=rep1&type=pdf > (accessed 06.12).
64. D. Livingstone, and K. Lynch Group project work and student-centred active learning: two different experiences Journal of Geography in Higher Education 26 2 2002 217 237
65. M. Magee, State of the Field Review: Simulations in Education, Alberta Online Learning Consortium, Alberta, Canada, 2006. < http://www.ccl-cca.ca/ pdfs/StateOfField/SFRSimulationinEducationJul06REV.pdf > (accessed 09.11).
66. A. Martin Adding value to simulation/games through Internet mediation: the medium and the message Simulation & Gaming 34 1 2003 23 38
67. C.H. Mason, and W.D. Perreault The Marketing Game! third ed. 2002 McGraw-Hill Boston, MA
68. C.F. Medley, and C. Horne Using simulation technology for undergraduate nursing education Journal of Nursing Education 44 1 2005 31 34
69. R.C. Mitchell Combining cases and computer simulations in strategic management courses Journal of Education for Business 79 4 2004 198 204
70. J. Moizer, J. Lean, T. Mangles, M. Warren, Teaching Introductory Management using A Computer Simulation Game. Paper Presented at 2000 International Conference on Systems Thinking in Management, Geelong, Australia, November 8-10, 2000. < http://ceur-ws.org/Vol-72/072%20Mozier%20Gaming.pdf > (accessed 07.10).
71. J. Moizer, J. Lean, M. Towler, and G. Smith Modes of learning in the use of a computer-based business simulation game International Journal of Learning Technology 2 1 2006 49 61
72. H.F. O'Neil, R. Wainessa, and E.L. Baker Classification of learning outcomes: evidence from the computer games literature The Curriculum Journal 16 4 2005 455 474
73. F. Pasin, and H. Giroux The impact of a simulation game on operations management education Computers & Education 57 1 2011 1240 1254
74. D. Pavlas, A Model of Flow and Play in Game-Based Learning: The Impact of Game Characteristics, Player Traits, and Player States, Unpublished Ph.D. Thesis, University of Central Florida, FL, 2010. < http://www.navistudios. net/Pavlas-Davin-A-201012-PhD.pdf > (accessed 09.11).
75. B.E. Peach, and M. Hornyak What are simulations for? Learning objectives as a simulation device Developments in Business Simulation and Experiential Learning 30 2003 213 219
76. N.W. Perry, M.T. Huss, B.D. McAuliff, and J. Galas An active-learning approach to teaching the undergraduate psychology and law course Teaching of Psychology 23 2 1996 76 81
77. V. Peters, and G. Vissers A simple classification model for debriefing simulation games Simulation & Gaming 35 1 2004 70 84
78. M. Prensky Digital Game-Based Learning 2001 McGraw-Hill New York, NY
79. A. Rollings, and E. Adams Andrew Rollings and Ernest Adams on Game Design 2003 New Riders Publishing Thousand Oaks, CA
80. E. Salas, J.L. Wildman, and R.F. Piccolo Using simulation based training to enhance management education Academy of Management Learning & Education 8 4 2009 559 573
81. L. Sauvé, L. Renaud, D. Kaufman, and J.S. Marquis Distinguishing between games and simulations: a systematic review Educational Technology & Society 10 3 2007 247 256
82. T. Sitzmann A meta-analytic examination of the instructional effectiveness of computer-based simulation games Personnel Psychology 64 2 2011 489 528
83. S.J. Stein, G. Isaacs, and T. Andrews Incorporating authentic learning experiences within a university course Studies in Higher Education 29 2 2004 239 258
84. StratXSimulations, Markstrat Overview, 2011. < http://www. stratxsimulations.com/markstrat-online-home.aspx > (accessed 10.11).
85. G.J. Summers Today's business simulation industry Simulation & Gaming 35 2 2004 208 241
86. M.A. Swanson, and D. Ornelas Health Jeopardy: a game to market school health services The Journal of School Nursing 17 3 2001 166 169
87. Y.H. Tao, C.J. Cheng, and S.Y. Sun What influences college students to continue using business simulation games? The Taiwan Experience, Computers & Education 53 3 2009 929 939
88. B. Thompson, and L.G. Daniel Factor analytic evidence for the construct validity of scores: a historical overview and some guidelines Educational and Psychological Measurement 56 2 1996 197 208
89. G.H. Tompson, and P. Dass Improving students' self-efficacy in strategic management: the relative impact of cases and simulations Simulation & Gaming 31 1 2000 22 41
90. D.G. Tonks Using marketing simulations for teaching and learning: reflections of an evolution Active Learning in Higher Education 3 2 2002 177 194
91. D.G. Tonks The processing and pedagogy of marketing simulations The Marketing Review 5 4 2005 371 382
92. D.G. Tonks, and S. Armitage A framework for understanding learning from management simulations Journal of Computer Assisted Learning 13 1 2003 48 58
93. M. Towler, J. Lean, and J. Moizer An exploration of student perception of a business simulation game International Journal of Management Education 7 2 2009 69 79
94. M. Ulicsak, M. Wright, Games in Education: Serious Games, Futurelab, Bristol, UK, 2010.
95. K. VanLehn, and M. Chi Adaptive expertise as acceleration of future learning: a case study P.J. Durlach, A.M. Lesgold, Adaptive Technologies for Training and Education 2012 Cambridge University Press Cambridge, MA 28 45
96. P. Wouters, C. van Nimwegen, H. van Oostendorp, and E.D. van der Spek A meta-analysis of the cognitive and motivational effects of serious games Journal of Educational Psychology 105 2 2013 249 265
97. K.E. Zantow, D. Knowlton, and D. Sharp More than fun and games: reconsidering the virtues of strategic management simulations Academy of Management Learning & Education 4 4 2005 451 458