An Evaluation of Gamified Training: Using Narrative to Improve Reactions and Learning

Simulation and Gaming

Volumn 48, Issue 4, 2017, Pages 513-538

  Armstrong, Michael B ^a   Landers, Richard N ^a  

^a OLD DOMINION UNIVERSITY   (United States)

Author keywords

attitudes; game elements; game fiction; game based learning; gamification; gamified learning; learning; narrative; psychology; training

Indexed keywords

EID: 85026851586     PISSN: 10468781     EISSN: 1552826X     Source Type: Journal    
DOI: 10.1177/1046878117703749     Document Type: Article

References (59)

1. Adams D. M., Mayer R. E., MacNamara A., Koenig A., Wainess R., (2012). Narrative games for learning: Testing the discovery and narrative hypotheses. Journal of Educational Psychology, 104(1), 235-249. doi:10.1037/10025595
2. Ajzen I., (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179-211. doi:10.1016/0749-5978(91)90020-T
3. Alliger G. M., Tannenbaum S. I., Bennett W., Jr. Traver H., Shotland A., (1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50, 341-358. doi:10.1111/j.1744-6570.1997.tb00911.x
4. Armstrong M. B., Landers R. N., Collmus A. C., (2015). Gamifying recruitment, selection, training, and performance management: Game-thinking in human resource management. In Davis D., Gangadharbatla H., (Eds.), Emerging research and trends in gamification (pp. 140-165). Hershey, PA: IGI Global. doi:10.4018/978-1-4666-8651-9.ch007
5. Baron R. M., Kenny D. A., (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6), 1173-1182. doi:10.1037/0022-3514.51.6.1173
6. Bedwell W. L., Pavlas D., Heyne K., Lazzara E. H., Salas E., (2012). Toward a taxonomy linking game attributes to learning: An empirical study. Simulation & Gaming, 43, 729-760. doi:10.1177/1046878112439444
7. Bourgonjon J., Valcke M., Soetaert R., Schellens T., (2010). Students’ perceptions about the use of video games in the classroom. Computers & Education, 54, 1145-1156. doi:10.1016/j.compedu.2009.10.022
8. Brown K. G., (2005). An examination of the structure and nomological network of trainee reactions: A closer look at “smile sheets”. Journal of Applied Psychology, 90, 991-1001. doi:10.1037/0021-9010.90.5.991
9. Campbell J. P., McCloy R. A., Oppler S. H., Sager C. E., (1993). A theory of performance. In Schmitt E., Borman W. C., (Eds.), Personnel selection in organizations (pp. 35-70). San Francisco, CA: Jossey-Bass.
10. Carini R. M., Kuh G. D., Klein S. P., (2006). Student engagement and student learning: Testing the linkages. Research in Higher Education, 47, 1-32. doi:10.1007/s11162-005-8150-9
11. Colquitt J. A., LePine J. A., Noe R. A., (2000). Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology, 85, 678-707. doi:10.1037//0021-9010.g5.5.678
12. Cordova D. I., Lepper M. R., (1996). Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology, 88(4), 715-730. doi:10.1037/0022-0663.88.4.715
13. Davis F. D., (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 319-430. Retrieved from http://www.jstor.org/stable/249008
14. Davis F. D., (1993). User acceptance of information technology: System characteristics, user perceptions and behavioral impacts. International Journal of Man-machine Studies, 38, 475-487. doi:10.1006/imms.1993.1022
15. Denny P., (2013, May). The effect of virtual achievements on student engagement. In Proceedings of CHI 2013: Changing Perspectives (pp. 763-772). Paris, France: ACM
16. Deterding S., Khaled R., Nacke L., Dixon D., (2011, May). Gamification: Toward a definition. Proceedings of the CHI 2011 Gamification Workshop, Vancouver, British Columbia, Canada. Retrieved from http://gamification-research.org/wp-content/uploads/2011/04/02-Deterding-Khaled-Nacke-Dixon.pdf
17. Deterding S., Dixon D., Khaled R., Nacke L., (2011, September). From game design elements to gamefulness: Defining “gamification”. Paper presented at MindTrek’11, Tempere, Finland. doi:10.1145/2181037.2181040
18. Dickey M. D., (2011). Murder on Grimm Isle: The impact of game narrative design in an educational game-based learning environment. British Journal of Educational Technology, 42(3), 456-469. doi:10.1111/j.1467-8535.2009.01032.x
19. Dong T., Dontcheva M., Joseph D., Karahalios K., Newman M. W., Ackerman M. S., (2012, May). Discovery-based games for learning software In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems (pp. 2083-2086). Austin, TX: ACM.
20. Duggan G. B., Payne S. J., (2009). Text skimming: The process and effectiveness of foraging through text under time pressure. Journal of Experimental Psychology: Applied, 15, 228-242. doi:10.1037/a0016995
21. Feeley T. H., Marshall H. M., Reinhart A. M., (2006). Reactions to narrative and statistical written messages promoting organ donation. Communication Reports, 19(2), 89-100. doi:10.1080/08934210600918758
22. Garris R., Ahlers R., Driskell J. E., (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33, 441-467. doi:10.1177/1046878102238607
23. Gopher D., Weil M., Bareket T., (1994). Transfer of skill from a computer game trainer to flight. Human Factors, 36(3), 387-405. doi:10.1177/001872089403600301
24. Graesser A. C., Hauft-Smith K., Cohen A. D., Pyles L. D., (1980). Advanced outlines, familiarity, and text genre on retention of prose. The Journal of Experimental Education, 48(4), 281-290. doi:10.1080/00220973.1980.11011745
25. Graesser A. C., Hoffman N. L., Clark L. F., (1980). Structural components of reading time. Journal of Verbal Learning and Verbal Behavior, 19, 135-151. doi:10.1016/S0022-5371(80)90132-2
26. Grossman R., Salas E., (2011). The transfer of training: What really matters. International Journal of Training and Development, 15, 103-120. doi:10.1111/j.1468-2419.2011.00373.x
27. Gustafsson A., Katzeff C., Bang M., (2009). Evaluation of a pervasive game for domestic energy engagement among teenagers. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology (pp. 232-239). Yokohoma, Japan: ACM.
28. Horton J. J., Chilton L. B., (2010, June). The labor economics of paid crowdsourcing. In Proceedings of the 11th ACM conference on Electronic commerce (pp. 209-218). Cambridge, MA: ACM.
29. Hsu C. L., Lu H. P., (2004). Why do people play on-line games? An extended TAM with social influences and flow experience. Information & Management, 41(7), 853–868. doi:10.1016/j.im.2003.08.014
30. Kopfman J. E., Smith S. W., Ah Yun J. K., Hodges A., (1998). Affective and cognitive reactions to narrative versus statistical evidence organ donation messages. Journal of Applied Communication Research, 26(3), 279-300. doi:10.1080/00909889809365508
31. Kozminsky E., (1977). Alterning comprehension: The effect of biasing titles on text comprehension. Memory & Cognition, 5(4), 482-490. doi:10.3758/BF03197390
32. Kraiger K., (2008). Transforming our models of learning and development: Web-based instruction as enabler of third-generation instruction. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 454-467. doi:10.1111/j.1754-9434.2008.00086.x
33. Kraiger K., Ford J. K., Salas E., (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78, 311-328. doi:10.1037/0021-9010.78.2.311
34. Landers R. N., (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation & Gaming, 45(6), 752-768. doi:10.1177/1046878114563660
35. Landers R. N., Armstrong M. B., (2017). Enhancing instructional outcomes with gamification: An empirical test of the Technology-Enhanced Training Effectiveness Model. Computers in Human Behavior, 71, 499-507. doi:10.1016/j.chb.2015.07.031
36. Landers R. N., Behrend T. S., (2015). An inconvenient truth: Arbitrary distinctions between organizational, Mechanical Turk, and other convenience samples. Industrial and Organizational Psychology: Perspectives on Science and Practice, 8, 142-164. doi:10.1017/iop.2015.13
37. Landers R. N., Callan R. C., (2011). Casual social games as serious games: The psychology of gamification in undergraduate education and employee training. In Ma M., Oikonomou A., Jain L. C., (Eds.), Serious games and edutainment applications (Vol. 1, pp. 399-424). Surrey, UK: Springer. doi:10.1007/978-1-4471-2161-9_20
38. Landers R. N., Callan R. C., (2012). Training evaluation in virtual worlds: Development of a model. Journal of Virtual Worlds Research, 5, 1-20. doi:10.4101/jvwr.v5i3.6335
39. Landers R. N., Callan R. C., (2014). Validation of the beneficial and harmful work-related social behavioral taxonomies: Development of the Work-related Social Media Questionnaire. Social Science Computer Review, 32, 628-646. doi:10.1177/0894439314524891
40. Landers R. N., Landers A. K., (2014). An empirical test of the theory of gamified learning: The effect of leaderboards on time-on-task and academic performance. Simulation & Gaming, 45(6), 769-785. doi:10.1177/1046878114563662
41. Li W., Grossman T., Fitzmaurice G., (2012, October). GamiCAD: A gamified tutorial system for first time AutoCAD users. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (pp. 103-112). Cambridge, MA: ACM.
42. Malone T. W., (1981). Towards a theory of intrinsically motivation instruction. Cognitive Science, 4, 333-369. doi:10.1016/S0364-0213(81)80017-1
43. Masson M. E. J., (1982). Cognitive processes in skimming stories. Journal of Experimental Psychology: Learning, Memory, and Cognition, 8, 400-417. doi:10.1037/0278-7393.8.5.400
44. McDrury J., Alterio M., (2002). Learning through storytelling in higher education: Using reflection & experience to improve learning. London, England: Routledge.
45. Norris S. P., Guilbert S. M., Smith M. L., Hakimelahi S., Phillips L. M., (2005). A theoretical framework for narrative explanation in science. Science Education, 89(4), 535-563. doi:10.1002/sce.20063
46. Osborne J., (2010). Improving your data transformations: Applying the Box-Cox transformation. Practical Assessment, Research, & Evaluation, 15(2). Retrieved from http://pareonline.net/getvn.asp?v=15&n=12
47. Parker L. E., Lepper M. R., (1992). Effects of fantasy contexts on children’s learning and motivation: Making learning more fun. Journal of Personality and Social Psychology, 62, 625-633. doi:10.1037/0022-3514.62.4.625
48. Sailer M., Hense J. U., Mayr S. K., Mandl H., (2017). How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior, 69, 371-380. doi:10.1016/j.chb.2016.12.033
49. Serrano E. L., Anderson J. E., (2004). The evaluation of food pyramid games, a bilingual computer nutrition education program for Latino youth. Journal of Family and Consumer Sciences Education, 22(1), 1-16.
50. Smith A., Baker L., (2011). Getting a clue: Creating student detectives and dragon slayers in your library. Reference Services Review, 39(4), 628-642. doi:10.1108/00907321111186659
51. Solomon R. L., (1949). An extension of control group design. Psychological Bulletin, 46(2), 137-150. doi:10.1037/h0062958
52. Squire K., Giovanetto L., Devane B., Durga S., (2005). From users to designers: Building a self-organizing game-based learning environment. TechTrends, 49(5), 34-74. doi:10.1007/BF02763688
53. Sweller J., (1988). Cognitive load during problem solving: effects on learning. Cognitive Science, 12, 257–285. doi:10.1207/s15516709cog1202_4
54. Thorndyke P. W., (1977). Cognitive structures in comprehension and memory of narrative discourse. Cognitive Psychology, 9, 77-110. doi:10.1016/0010-0285(77)90005-6
55. Tun P. A., (1989). Age differences in processing expository and narrative text. Journal of Gerontology, 44(1), 9-15. doi:10.1093/geronj/44.1.P9
56. Venkatesh V., Bala H., (2008). Technology acceptance model 3 and a research agenda on interventions. Decision Sciences, 39, 273-315. doi:10.1111/j.1540-5915.2008.00192.x
57. Venkatesh V., Davis F. D., (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46(2), 186-204. doi:10.1287/mnsc.46.2.186.11926
58. Virvou M., Katsionis G., Manos K., (2005). Combining software games with education: Evaluation of its educational effectiveness. Educational Technology & Society, 8(2), 54-65. Retrieved from http://www.jstor.org/stable/jeductechsoci.8.2.54
59. Zabrucky K. M., Moore D., (1999). Influence of text genre on adults’ monitoring of understanding and recall. Educational Gerontology, 25, 691-710. doi:10.1080/036012799267440