Relationships between game attributes and learning outcomes: Review and research proposals

Simulation and Gaming

Volumn 40, Issue 2, 2009, Pages 217-266

  Wilson, Katherine A ^a   Bedwell, Wendy L ^b   Lazzara, Elizabeth ^b   Salas, Eduardo ^b   Burke, Shawn C ^b   Estock, Jamie L ^c   Orvis, Kara L ^c   Conkey, Curtis ^d  

^a UNIVERSITY OF MIAMI MILLER SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF CENTRAL FLORIDA   (United States)

^c APTIMA INC   (United States)

^d NONE   (United States)

Author keywords

Game attributes; Games; Learning; Learning outcomes; Research; Simulation; Training

Indexed keywords

EID: 63749091715     PISSN: 10468781     EISSN: 1552826X     Source Type: Journal    
DOI: 10.1177/1046878108321866     Document Type: Review

References (109)

1. Adams, P.C. (1998). Teaching and learning with SimCity 2000. Journal of Geography, 97(2), 47-55.
2. American Society for Training and Development. (2007). ASTD policy brief. Retrieved February 29, 2008, from http://www.astd.org/NR/ rdonlyres/8C6FDB15-3861-4C27-86DF-7F35917E4A57/14737/APBFall07.pdf
3. Anderson, C.A., & Barlett, C.P. (in press). Violent video games: Confirmed, suspected, and purely speculative effects. Simulation & Gaming: An Interdisciplinary Journal.
4. Anderson, P., & Lawton, L. (2008). Business simulations and cognitive learning: Developments, desires and future directions. Simulation & Gaming: An Interdisciplinary Journal. Prepublished July 31, 2008; DOI: 10.1177/1046878108321871.
5. Arnseth, H.C., & McFarlane, A. (in press). Learning from games... A discussion of games conceived as models of learning design or as effective tools for producing learning outcomes. Simulation & Gaming: An Interdisciplinary Journal.
6. Asgari, M., & Kaufman, D. (2004). Relationships among computer games, fantasy, and learning. Proceedings of the 2nd International Conference on Imagination and Education. Retrieved August 15, 2005, from http://www.ierg.net/confs/2004/
7. Bandura, A. (1977). Social learning theory. New York: General Learning Press.
8. Bandura, A. (1994). Self-efficacy. In V. S. Ramachaudran (Ed.), Encyclopedia of human behavior (Vol. 4, pp. 71-81). New York: Academic Press.
9. Belanich, J., Sibley, D.E., & Orvis, K.L. (2004). Instructional characteristics and motivational features of a PC-based game (Research report 1822). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.
10. Bloom, B. S. (Ed.). (1956). Taxonomy of educational objectives, Handbook 1: Cognitive domain. New York: David McKay.
11. Blunt, R. (2007). Does game-based learning work? Results from three recent studies. In Proceedings of the Interservice/Industry Training, Simulation, & Education Conference (pp. 945-955). Orlando, FL: National Defense Industrial Association.
12. Borodzicz, E., & van Haperen, K. (2002). Individual and group learning in crisis simulations. Journal of Contingencies and Crisis Management, 10(3), 139-147.
13. Bowers, C.A., & Jentsch, F. (2001). Use of commercial off-the-shelf, simulations for team research. In C. A. Bowers & E. Salas (Eds.), Advances in human performance and cognitive engineering research (pp. 293-317). Mahwah, NJ: Lawrence Erlbaum.
14. Bowman, R.F. (1982). A "Pac-Man" theory of motivation: Tactical implications for classroom instruction. Educational Technology, 22(9), 14-17.
15. Boyatzis, R., & Kolb, D.A. (1995). From learning styles to learning skills: The executive skills profile. Journal of Managerial Psychology, 10(5), 3-17.
16. Bredemeier, M.E. & Greenblatt, C.E. (1981). The educational effectiveness of games: A synthesis of findings. Simulation & Gaming, 12(3), 307-332.
17. Carlson, H.L. (1991). Learning style and program design in interactive multimedia. Educational Technology, Research and Development, 39, 41-48.
18. Chamberlain, B. (2003). Creating entertaining games with educational content: Case studies of user experiences with the children's website, Food Detectives Fight Bac! Unpublished doctoral dissertation, University of Virginia, Charlottesville.
19. Chen, S., & Michael, D. (2005, October 19). Proof of learning: Assessment in Serious Games. Gamasutra. Retrieved October 9, 2006, from http://www.gamasutra.com/features/20051019/chen_01.shtml
20. Cordova, D.I., & Lepper, M.R. (1996). Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology, 88, 715-730.
21. Crawford, C. (1984). The art of computer design. Berkeley, CA: Osborne/ McGraw-Hill.
22. Crown, S.W. (2001). Improving visualization skills of engineering graphics students using simple JavaScript web based games. Journal of Engineering Education, 90(3), 347-355.
23. Day, E.A., Arthur, W., Jr., & Gettman, D. (2001). Knowledge structures and the acquisition of a complex skill. Journal of Applied Psychology, 86(5), 1022-1033.
24. de Felix, J.W., & Johnson, R.T. (1993). Learning from video games. Computers in the Schools, 9(2/3), 119-134.
25. Dennis, K.A., & Harris, D. (1998). Computer-based simulation as an adjunct to ab initio flight training. International Journal of Aviation Psychology, 8(3), 261-276.
26. DeRouin, R.E., Fritzsche, B.A., & Salas, E. (2004). Optimizing e-learning: Research-based guidelines for learner-controlled training. Human Resource Management Journal, 43(2/3), 147-162.
27. Dormann, C., & Biddle, R. (in press). Humor in simulation and gaming: Learning and laughter. Simulation & Gaming: An Interdisciplinary Journal.
28. Driskell, J.E., & Dwyer, J.D. (1984) Microcomputer videogame based training. Educational Technology, 24(2), 11-16.
29. Egenfeldt-Nielsen, S. (2007). Third generation educational use of computer games. Journal of Educational Multimedia and Hypermedia, 16(3), 263-281.
30. Faria, A.J., Gold, S., Wellington, B., Hutchinson, D. (in press). Developments in business gaming over the past 40 years. Simulation & Gaming: An Interdisciplinary Journal.
31. Feinstein, A.H., & Cannon, H.M. (2002). Constructs of simulation evaluation. Simulation & Gaming, 33(4),425-440.
32. Fletcher, J.D., & Tobias, S. (2006, February). Using computer games and simulations for instruction: A research review. Paper presented at the Society for Applied Learning Technology Meeting, New Learning Technologies, Orlando, FL.
33. Fong, G. (2006). Adapting COTS games for military experimentation. Simulation & Gaming, 37(4), 452-465.
34. Gaba, D.M., Howard, S.K., Fish, K.J., Smith, B.E., & Sowb, Y.A. (2001). Simulation-based training in anesthesia crisis resource management (ACRM): A decade of experience. Simulation & Gaming, 32, 175-193.
35. Gagne, R.M. (1984). Learning outcomes and their effects: Useful categories of human performance. American Psychologist, 39, 377-385.
36. Gander, S. (2002). Does learning occur through gaming. Electronic Journal of Instructional Science and Technology, 3(2).
37. Garris, R., & Ahlers, R. (2001, December). A game-based training model: Development, application, and evaluation. Paper presented at the Interservice/Industry Training, Simulation & Education Conference, Orlando, FL.
38. Garris, R., Ahlers, R. & Driskell, J.E. (2002). Games, motivation and learning: A research and practice model. Simulation & Gaming, 33(4), 441-467.
39. Gopher, D., Weil, M., & Bareket, T. (1994). Transfer of skill from a computer game trainer to flight. Human Factors, 36(3), 387-405.
40. Gremmen, H., & Potters, H. (1995). Assessing the efficacy of gaming in economics education. Retrieved May 6, 2008, from http://arno.uvt.nl/ show.cgi?fid=3278
41. Habgood, M.P.J. (2005, June). Zombie division: Integration in digital learning games. Paper presented at the 2005 Human Centered Technology Workshop, Brighton, UK.
42. Habgood, M.P.J., Ainsworth, S.E., & Benford, S. (2005, June). Endogenous fantasy and learning in digital games. Simulation & Gaming, 36(4), 483-498.
43. Harbeck, J.D., & Sherman, T.M. (1999). Seven principles for designing developmentally appropriate web sites for young children. Educational Technology, 39(4), 39-44.
44. Hays, R.T. (2005). The effectiveness of instructional games: A literature review and discussion (Technical Report No. 2005-004). Naval Air Warfare Center Training Systems Division, Orlando, FL.
45. Juul, J. (2003). The game, the player, the world: Looking for a heart of gameness. In M. Copier & J. Raessens, (Eds.), Proceedings at the Level Up: Digital Games Research Conference, November 4-6 (pp. 30-45). Utrecht, the Netherlands: Utrecht University.
46. Kagan, J. (1972). Motives and development. Journal of Personality and Social Psychology, 22, 51-66.
47. Klawe, M.M. (1998). When does the use of computer games and other interactive multimedia software help students learn mathematics? Retrieved online March 3, 2008, from http://mathforum.org/technology/ papers/papers/klawe.html
48. Kraiger, K., Ford, J., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78(2), 311-328.
49. Krathwohl, D.R. (2002). A revision of Bloom's taxonomy: An overview. Theory Into Practice, 41(4), 212.
50. Krathwohl, D.R., Bloom, B.S., & Masia, B.B. (1964). Taxonomy of educational objectives: The classification of educational goals. Handbook II: The affective domain. New York: David McKay.
51. Lai, S. (2001). Controlling the display of animation for better understanding. Journal of Research on Computing in Education, 33. Retrieved February 25, 2004, from http://www.iste.org/jrte/33/5/lai.cfm
52. Lane, J.L., Slavin, S., & Ziv, A. (2001). Simulation in medical education: A review. Simulation & Gaming, 32(3), 297-314.
53. Leemkuil, H., de Jong, T., & Ootes, S. (2000). Review of educational use of games and simulations (Knowledge management Interactive Training System Project No. IST-1999-13078). Enschede, Netherlands: University of Twente. Retrieved April 29, 2008, from http://kits.edte.utwente.nl/ documents/D1.pdf
54. Lepper, M.R. (1985). Microcomputers in education: Motivational and social issues. American Psychologist, 40(1), 1-18.
55. Lepper, M.R., & Chabay, R.W. (1985). Intrinsic motivation and instruction: Conflicting views on the role of motivational processes in computer-based education. Educational Psychologist, 20(4), 217-230.
56. Locke, E.A., & Latham, G.P. (2002). Building a practically useful theory of goal setting and task motivation: A 35 year odyssey. American Psychologist, 57(9), 705-717.
57. Locke, E.A., & Latham, G.P. (1990). A theory of goal setting and task performance. Englewood Cliffs, NJ: Prentice Hall.
58. Malone, T.W. (1980, September). What makes things fun to learn? Heuristics for designing instructional computer games. Paper presented at the 3rd ACM SIGSMALL Symposium on Small and Personal Computer Systems, Palo Alto, CA.
59. Malone, T.W. (1981). Towards a theory of intrinsically motivation instruction. Cognitive Science, 4, 333-369.
60. Malone, T.W., & Lepper, M.R. (1987). Making learning fun: A taxonomy of intrinsic motivations for learning. In R. E. Snow & M. J. Farr (Eds.), Aptitude, learning and instruction: Vol. 3. Cognitive and affective process and analyses (pp. 223-253). Hillsdale, NJ: Lawrence Erlbaum.
61. Marks, M.A. (2000). A critical analysis of computer simulations for conducting team research. Small Group Research, 31(6), 653-675.
62. Mayer, R.E., Mautone, P., & Prothero, W. (2002). Pictorial aids for learning by doing in a multimedia geology simulation game. Journal of Educational Psychology, 94(1), 171-185.
63. McFarlane, A., Sparrowhawk, A. & Heald, Y. (2002). Report on the educational use of games: An exploration by TEEM of the contribution which games can make to the education process. Retrieved September 7, 2007, from http://reservoir.cent.uji.es/canals/octeto/es/440
64. Merzenich, M.M., Jenkins, W.M., Johnston, J.P., Schreiner, C., Miller, S.L., & Tallal, P. (1996). Temporal processing deficits of language-learning impaired children ameliorated by training. Science, 271, 77-81.
65. Mishra, P., & Foster, A. (2007). The claims of games: A comprehensive review and directions for future research. In C. Crawford, D. Willis, R. Carlsen, I. Gibson, K. McFerrin, J. Price, et al. (Eds.), Proceedings of Society for Information Technology and Teacher Education International Conference 2007 (pp. 2227-2232). Chesapeake, VA: Association for the Advancement of Computing Education.
66. Naylor, J.C., Pritchard, R.D., & Ilgen, D.R. (1980). A theory of behavior in organizations. New York: Academic Press.
67. Noble, A., Best, D., Sidell, C., & Strang, J. (2000). Is an arcade-style computer game an effective medium for providing drug education to school children? Education for Health, 13(3), 404-406.
68. O'Neil, H.F., Wainess, R., & Baker, E.L. (2005). Classification of learning outcomes: Evidence from the computer games literature. The Curriculum Journal, 16(5), 455-474.
69. Orvis, K.A., Orvis, K.I., Belanich, J., & Mullin, L.N. (2008). The influence of trainee gaming experiences on affective and motivational learner outcomes of videogame-based training environments. In H. F. O'Neil & R. S. Perez (Eds.), Computer games and team and individual learning (pp. 125-143). Oxford, UK: Elsevier.
70. Oswalt, I. (1993). Current applications, trends, and organizations in U.S. military simulation and gaming. Simulation & Gaming, 24(2), 153-189.
71. Owen, M. (2004). An anatomy of games: A discussion paper. Futurelab. Retrieved September 11, 2006, from http://www.futurelab.org.uk/download/ pdfs/research/disc_papers/Anatomy_of_Games_discpaper.pdf
72. Pange, J. (2003). Teaching probabilities and statistics to preschool children. Information Technology in Childhood Education Annual, 163-172.
73. Parker, L.E., & Lepper, M.R. (1992). Effects of fantasy contexts on children's learning and motivation: Making learning more fun. Journal of Personality and Social Psychology, 62(4), 625-633.
74. Parry, S.B. (1971). The name of the game is simulation. Training and Development Journal, 25(2), 28-32.
75. Prensky, M. (2001). Digital game-based learning. New York: McGraw-Hill.
76. Prince, C., & Jentsch, F. (2001). Aviation crew resource management training with low-fidelity devices. In E. Salas, C. A. Bowers, & E. Edens (Eds.), Improving teamwork in organizations: Applications of resource management training (pp. 147-164). Mahwah, NJ: Lawrence Erlbaum.
77. Pritchard, R.D., & Ashwood, E.L. (2008). Manager's guide to diagnosing and improving motivation. New York: Psychology Press.
78. Proctor, M.D., Panko, M., & Donovan, S.J. (2004). Considerations for training team situation awareness and task performance through PC-gamer simulated multi-ship helicopter operations. The International Journal of Aviation Psychology, 14(2), 191-205.
79. Randel, J.M., Morris B. A., Wetzle, C.D., & Whitehead, B.V. (1992). The effectiveness of games for educational purposes: A review of recent research. Simulation and Gaming, 23, 261-276.
80. Renaud, L., & Stolovitch, H. (1988). Simulation gaming: An effective strategy for creating appropriate traffic safety behaviors in five-year-old children. Simulation & Games, 19(3), 328-345.
81. Ricci, K.E., Salas, E., & Cannon-Bowers, J.A. (1996). Do computer-based games facilitate knowledge acquisition and retention? Military Psychology, 8(4), 295-307.
82. Rieber, L.P. (1996). Seriously considering play: Designing interactive learning environments on the blending of microworlds, simulations, and games. Educational Technology Research & Development, 44(2), 43-58.
83. Rieber, L.P., & Noah, D. (1997). Seriously considering play: Designing interactive learning environments on the blending microworlds, simulations, and games. Educational Technology Research & Development, 44(2), 43-58.
84. Ronen, M., & Eliahu, M. (2000). Simulation-a bridge between theory and reality: The case of electrical circuits. Journal of Computer Assisted living, 16, 14-26.
85. Rosas, R., Nussbaum, M., Cumsille, P., Marianov, V., Correa, M., & Flores, P., et al. (2003). Beyond Nintendo: A design and assessment of educational video games for first and second grade students. Computers & Education, 40, 71-94.
86. Rosenblum, L., Julier, S., Nakamoto, T., Otaguro, S., Kinoshita, M., Nagahama, M., Ohinishi, K., & Ishida, T. (2008). Cooking up an interactive olfactory game display. IEEE Computer Graphics & Applications, 28(1), 75-78.
87. Salas, E., & Cannon-Bowers, J.A. (2000). The anatomy of team training. In S. Tobias & J. D. Fletcher (Eds.), Training & retraining: A handbook for business, industry, government, and the military (pp. 312-335). New York: Macmillan.
88. Serrano, E.L., & Anderson, J.E. (2004). The evaluation of food pyramid games, a bilingual computer nutrition education program for Latino youth. Journal of Family and Consumer Sciences Education, 22(1), 1-16.
89. Senge, P.M. (n.d.). Learning to alter mental models. Retrieved May 19, 2008, from http://www.solne.org/res/kr/mentmodel.html
90. Simpson, E.J. (1972). The classification of educational objectives in the psychomotor domain. Washington, DC: Gryphon House.
91. Smith, P., Sciarini, L., & Nicholson, D. (2007). The utilization of low cost gaming hardware in conventional simulation. In Proceedings of the Interservice/Industry Training, Simulation, & Education Conference (pp. 965-972). Orlando, FL: National Defense Industrial Association.
92. Squire, K., Giovanetto, L., Devane, B., & Durga, S. (2005). From users to designers: Building a self-organizing game-based learning environment, TechTrends, 49(5), 34-42.
93. Stoney, S., & Wild, M. (1998). Motivation and interface design: Maximising learning opportunities. Journal of Computer Assisted Learning, 14, 40-50.
94. Strohschneider, S., & Gerdes, J. (2004). MS ANTWERPEN: Emergency management training for low-risk environments. Simulation & Gaming, 35(3), 394-413.
95. Szafran, R.F., & Mandolini, A.F. (1980). Test performance and concept recognition: The effect of a simulation game on two types of cognitive knowledge. Simulation & Games, 11(3), 326-335.
96. Thatcher, D.C. (1990). Promoting learning through games and simulations. Simulation & Gaming, 21(3), 262-273.
97. Thiagarajan, S. (1999). Team activities for learning and performance. In H. D. Stolovitch & E. J. Keeps (Eds.), Handbook of Human Performance Technology (pp. 518-544). San Francisco: Jossey-Bass/Pfeiffer.
98. Thomas, R., Cahill, J., & Santilli, L. (1997). Using an interactive computer game to increase skill and self-efficacy regarding safer sex. Health Education and Behavior, 24(1), 71-86.
99. Van Eck, R. (2006). Digital game based learning: It's not just the digital natives who are restless. Educause Review, 41(2), 17-30.
100. Van Eck, R., & Dempsey, J. (2002). The effect of competition and contextualized advisement on the transfer of mathematics skills in a computer-based instructional simulation game. Educational Technology Research and Development, 50(3), 23-41.
101. Veale, T.K. (1999). Targeting temporal processing deficits through Fast ForWord: Language therapy with a new twist. Language, Speech and Hearing Services in Schools, 30, 353-362.
102. Virvou, M., Katsionis, G., & Manos, K. (2005). Combining software games with education: Evaluation of its educational effectiveness. Educational Technology & Society, 8(2), 54-65.
103. Vogel, J.J., Vogel, D.S., Cannon-Bowers, J., Bowers, C.A., Muse, K., & Wright, M. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229-243.
104. Westrom, M., & Shaban, A. (1992). Intrinsic motivation in microcomputer games. Journal of Research on Computing in Education, 24(4), 433-445.
105. White, B.Y. (1984). Designing computer games to help physics students understand Newton's laws of motion. Cognition and Instruction, 1(1), 69-108.
106. White, R.W. (1959). Motivation reconsidered: The concept of competence. Psychological Review, 66, 297-333.
107. Whitehall, B.V., & McDonald, B.A. (1993). Improving learning persistence of military personnel by enhancing motivation in a technical training program. Simulation & Gaming, 24(3), 294-313.
108. Wishart, J. (1990). Cognitive factors related to user involvement with computers and their effects upon learning from an educational computer game. Computers and Education, 15(1-3), 145-150.
109. Woodman, M.D. (2006). Cognitive training transfer using a personal computer-based game: A close quarters battle case study. Unpublished doctoral dissertation, University of Central Florida.