Gamifying education: what is known, what is believed and what remains uncertain: a critical review

International Journal of Educational Technology in Higher Education

Volumn 14, Issue 1, 2017, Pages

  Dichev, Christo ^a   Dicheva, Darina ^a  

^a WINSTON SALEM STATE UNIVERSITY   (United States)

Author keywords

Critical literature review; Empirical studies; Gamification in education; Gamifying learning

Indexed keywords

EID: 85013804966     PISSN: None     EISSN: 23659440     Source Type: Journal    
DOI: 10.1186/s41239-017-0042-5     Document Type: Review

References (87)

1. Amriani, A., Aji, A., Utomo, A. Y., Wahidah, F., & Junus, K. (2014). Gamified E-learning model based on community of inquiry. In 2014 IEEE International Conference on Advanced Computer Science and Information Systems, Jakarta, 474–480, doi: 10.1109/ICACSIS.2014.7065830.
2. Anderson, P. E., Nash, T., & McCauley, R. (2015). Facilitating programming success in data science courses through gamified scaffolding and Learn2Mine, ITICSE ‘15, July 04–08, 2015, Vilnius, Lithuania.
3. Attali, Y., & Arieli-Attali, M. (2015). Gamification in assessment: do points affect test performance? Computers & Education, 83, 57–63.
4. Auvinen, T., Hakulinen, L., & Malmi, L. (2015). Increasing Students’ Awareness of their Behavior in Online Learning Environments with Visualizations and Achievement Badges, IEEE Transactions on Learning Technologies, 8(3), 261–273, doi: 10.1109/TLT.2015.2441718.
5. Barata, G., Gama, S., Jorge, J., & Gonçalves, D. (2014). Identifying student types in a gamified learning experience. International Journal of Game-Based Learning (IJGBL), 4(4), 19–36.
6. Barrio, C.M., Organero M.M., & Soriano, J. S. (2015). Can Gamification Improve the Benefits of Student Response Systems in Learning? An Experimental Study. IEEE Transactions on Emerging Topics in Computing, PP(99). doi: 10.1109/TETC.2015.2497459.
7. Bernik, A., Bubaš, G., & Radošević, D. (2015). A pilot study of the influence of gamification on the effectiveness of an e-Learning Course. In 26th Central European Conference on Information and Intelligent Systems (CECIIS 2015). (pp. 73–79). Varazdin: Faculty of Organization and Informatics.
8. Biro, G. I. (2014). Didactics 2.0: a pedagogical analysis of gamification theory from a comparative perspective with special view to the components of learning. Procedia - Social and Behavioral Sciences, 141, 148–151.
9. Bonde, M. T., Makransky, G., Wandall, J., Larsen, M. V., Morsing, M., Jarmer, H., & Sommer, M. O. (2014). Improving biotech education through gamified laboratory simulations. Nature Biotechnology, 32(7), 694–697.
10. Borges, S. S., Durelli, V. H. S., Reis, H. M., & Isotani, S. (2014). A systematic mapping on gamification applied to education. In ACM SAC’14 Conference, Gyeongju, South Korea (pp. 216–222).
11. Boskic, N., & Hu, S. (2015). Gamification in higher education: how we changed roles. European Conference on Games Based Learning, (pp. 741–748). Reading, UK: Academic Conferences and Publishing International Limited.
12. Boticki, I., Baksa, J., Seow, P., & Looi, C. K. (2015). Usage of a mobile social learning platform with virtual badges in a primary school. Computers & Education, 86, 120–136.
13. Broer, J. (2014). Gamification and the trough of disillusionment. In A. Butz, M. Koch, & J. Schlichter (Eds.), Mensch & Computer 2014 - Workshopband (pp. 389–395). Berlin: De Gruyter Oldenbourg.
14. Caponetto, I., Earp, J., & Ott, M. (2014). Gamification and education: a literature review. In 8th European Conference on Games Based Learning (pp. 50–57). Germany: ECGBL. ISBN 978-1-910309-55-1.
15. Chang, J.W., & Wei, H.Y. (2015). Exploring Engaging Gamification Mechanics in Massive Online Open Courses, Educational Technology & Society, 12/2015 (in print).
16. Christy, K. R., & Fox, J. (2014). Leaderboards in a virtual classroom: a test of stereotype threat and social comparison explanations for women’s math performance. Computers & Education, 78, 66–77.
17. Codish, D., & Ravid, G. (2014). Academic course gamification: the art of perceived playfulness. Interdisciplinary Journal of E-Learning and Learning Objects, 10, 131–151.
18. Codish, D., & Ravid, G. (2015). Detecting playfulness in educational gamification through behavior patterns. IBM Journal of Research and Development, 59(6), 1–14. doi:10.1147/JRD.2015.2459651
19. Davis, K., & Klein, E. (2015). Investigating high school students’ perceptions of digital badges in afterschool learning. In ACM Conference on Human Factors in Computing Systems (CHI ‘15), (pp. 4043–4046). New York, NY: ACM
20. Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: defining gamification. In 15th International Academic MindTrek Conference: Envisioning Future Media Environments (pp. 9–15). New York, NY: ACM.
21. Dichev, C., Dicheva, D., Angelova, G., & Agre, G. (2014). From gamification to gameful design and gameful experience in learning. Journal of Cybernetics and Information Technologies, 14(4), 80–100. doi:10.1515/cait-2014-0007
22. Dicheva, D., & Dichev, C. (2015). Gamification in education: where are we in 2015? World Conference on E-Learning (ELEARN 2015), Kona, Hawaii, October 19–22 (pp. 1276–1284). Chesapeake: AACE.
23. Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: a systematic mapping study. Educational Technology & Society, 18(3), 75–88.
24. Enders, B., & Kapp, K. (2013). Gamification, Games, and Learning: What Managers and Practitioners Need to Know, Hot Topics, The eLearning Guild Research, 1–7.
25. Faiella, F., & Ricciardi, M. (2015). Gamification and learning: a review of issues and research. Journal of e-Learning and Knowledge Society, 11(3), 13–21.
26. Gartner. (2013). Hype cycle for emerging technologies, 2013. Retrieved from http://www.gartner.com/document/2571624. Accessed 15 Apr 2016.
27. Gerber, H. (2014). Problems and Possibilities of Gamifying Learning: A Conceptual Review. Internet Learning Journal, 3 (2), Article 5. Retrieved from http://digitalcommons.apus.edu/internetlearning/vol3/iss2/5. Accessed 16 Jan 2017.
28. Gooch, D., Vasalou, A., Benton, L., & Khaled, R. (2016). Using gamification to motivate students with dyslexia. CHI 2016, May 7–12 2016, San Jose.
29. Hakulinen, L., Auvinen, T., & Korhonen, A. (2015). The effect of achievement badges on students’ behavior: an empirical study in a university-level computer science course. International Journal of Emerging Technologies in Learning (iJET), 10(1), 18–29.
30. Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work? – A literature review of empirical studies on gamification. In 47th Hawaii International Conference on System Sciences, Hawaii, USA (pp. 3025–3034). doi:10.1109/HICSS.2014.377.
31. Hansch, A., Newman, C., & Schildhauer, T. (2015). Fostering Engagement with Gamification: Review of Current Practices on Online Learning Platforms. (November 23, 2015). HIIG Discussion Paper Series No. 2015–04. Retrieved from http://dx.doi.org/10.2139/ssrn.2694736.
32. Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: a longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education, 80, 152–161.
33. Hasegawa, T., Koshino, M., & Ban, H. (2015). An English Vocabulary Learning Support System for the Learner’s Sustainable Motivation. Springer Plus: Innovative Cloud Application in Computer Intelligence, 4 (99). doi: 10.1186/s40064-015-0792-2.
34. Herbert, B., Charles, D., Moore, A., & Charles, T. (2014). An investigation of gamification typologies for enhancing learner motivation. In International Conference on Interactive Technologies and Games, UK (pp. 71–78).
35. Hew, K. F., Huang, B., Chu, K. W. S., & Chiu, D. K. W. (2016). Engaging Asian students through game mechanics: findings from two experiment studies. Computers & Education, 92–93, 221–236.
36. Holman, C., Aguilar, S., & Fishman, B. (2013). GradeCraft: what can we learn from a game-inspired learning management system? Third International Conference on Learning Analytics and Knowledge, 2013, (pp. 260–264). New York, NY: ACM.
37. Holman, C., Aguilar, S. J., Levick, A., Stern, J., Plummer, B., & Fishman, B. (2015). Planning for success: how students use a grade prediction tool to win their classes. In 2015 Third International Conference on Learning Analytics and Knowledge, (pp. 260–264). New York, NY: ACM.
38. Ibanez, M., Di Serio, A., & Delgado-Kloos, C. (2014). Gamification for engaging computer science students in learning activities: a case study. IEEE Transactions on Learning Technologies, 7(3), 291–301.
39. Jang, J., Park, J., & Yi, M. Y. (2015). Gamification of online learning. In 17th International Conference on Artificial Intelligence in Education (AIED) (pp. 646–649). Switzerland: Springer International Publishing.
40. Knutas, A., Ikonen, J., Maggiorini, D., Ripomonti, L., & Porras, J. (2014a). Creating software engineering student interaction profiles for discovering gamification approaches to improve collaboration. In 15th International Conference on Computer Systems and Technologies (CompSysTech’14), (pp. 378–385). New York, NY: ACM.
41. Knutas, A., Ikonen J., Nikula, U., & Porras, J. (2014). Increasing Collaborative Communications in a Programming Course with Gamification: A Case Study. 15th Int. Conference on Computer Systems and Technologies (CompSysTech’14), (pp. 370–377). New York, NY: ACM
42. Koivisto, J., & Hamari, J. (2014). Demographic differences in perceived benefits from gamification. Computers in Human Behavior, 35, 179–188.
43. Krause, M., Mogalle, M., Pohl, H., & Williams, J. J. (2015). A playful game changer: fostering student retention in online education with social gamification. In L@S’15 Proc. of Learning@ Scale Conference (pp. 95–102). Vancouver: ACM Press.
44. Lambruschini, B. B., & Pizarro, W. G. (2015). Tech - Gamification in University Engineering Education. In 10th International Conference on Computer Science & Education (ICCSE 2015) (pp. 295–299) IEEE Conference Publications, doi: 10.1109/ICCSE.2015.7250259.
45. Landers, R. N. (2015). Developing a theory of gamified learning: linking serious games and gamification of learning. Simulation & Gaming, 45, 752–768.
46. Landers, R. N., Bauer, K. N., Callan, R. C., & Armstrong, M. B. (2015). Psychological theory and the gamification of learning. In T. Reiners & L. Wood (Eds.), Gamification in education and business (pp. 165–186). Cham: Springer.
47. Landers, R. N., & Landers, A. K. (2015). An empirical test of the theory of gamified learning: the effect of leaderboards on time-on-task and academic performance. Simulation & Gaming, 45, 769–785.
48. Laskowski, M., & Badurowicz, M. (2014). Gamification in Higher Education: A Case Study. In MakeLearn 2014: Human Capital without Borders: Knowledge and Learning for Quality of Life. Management, Knowledge and Learning International Conference, 971–975. (pp. 971–975). Portorož: ToKnowPress.
49. Latulipe, C., Long, N. B., & Seminario, C. E. (2015). Structuring flipped classes with lightweight teams and gamification. SIGCSE, 2015, Proceedings of the 46th ACM Technical Symposium on Computer Science Education (pp. 392–397). New York, NY: ACM
50. Leach, D., Laur, B., Code, J., Bebbington, T., & Broome, D. (2014). Gamification for online engagement in higher education: a randomized controlled trial (pp. 151–159). Madison: Games Learning + Society Conference.
51. Lehtonen, T., Aho, T., Isohanni, E., & Mikkonen, T. (2015). On the role of gamification and localization in an open online learning environment: Javala experiences. In 15th Koli Calling Conference on Computing Education Research (pp. 50–59). New York, NY: ACM.
52. Lieberoth, A. (2015). Shallow gamification – psychological effects of framing an activity as a game. Games and Culture, 10(3), 249–268.
53. Linehan, C., Kirman, B., Lawson, S., & Chan, G. (2011). Practical, appropriate, empirically-validated guidelines for designing educational games. In ACM Annual Conference on Human Factors in Computing Systems, May 7–12 (pp. 1979–1988). Canada: Vancouver.
54. Long, Y., & Aleven, V. (2014). Gamification of joint student/system control over problem selection in a linear equation tutor. In S. Trausan-Matu, K. E. Boyer, M. Crosby, & K. Panourgia (Eds.), 12th International Conference on Intelligent Tutoring Systems, ITS 2014 (pp. 378–387). Honolulu: Springer International Publishing.
55. Mahnič, N. (2014). Gamification of politics: start a new game! Teorija in Praksa, 51(1), 143–161.
56. McGonigal, J. (2011). Reality is broken: why games make us better and how they can change the world. New York: Penguin.
57. Mekler, E. D., Brühlmann, F., Tuch, A. N., & Opwis, K. (2015). Towards Understanding the Effects of Individual Gamification Elements on Intrinsic Motivation and Performance. Computers in Human Behavior. doi:10.1016/j.chb.2015.08.048.
58. Mora, A., Riera, D., & Gonzalez, C. (2015). A literature review of gamification design frameworks. In Seventh International conference on Virtual Worlds and Games for Serious Applications: VS-Games, Sweden (pp. 1–8). doi:10.1109/VS-GAMES.2015.7295760.
59. Morrison, B., & DiSalvo, B. (2014). Khan Academy Gamifies Computer Science. In Proceedings of SIGCSE’2014 45th ACM Technical Symposium on Computer Science Education, ACM (pp. 39–44).
60. Morschheuser, B. S., Rivera-Pelayo, V., Mazarakis, A., & Zacharias, V. (2014). Interaction and reflection with quantified self and gamification: an experimental study. Journal of Literacy and Technology, 15(2), 136–156.
61. Naik, L. (2015). Gamification Isn’t Dead, It’s Just Very Misunderstood. Pulse, July 2015. Available at https://www.linkedin.com/pulse/gamification-isnt-dead-its-just-very-misunderstood-lee-naik.
62. Nevin, C. R., Westfall, A. O., Rodriguez, J. M., Dempsey, D. M., Cherrington, A., Roy, B., Patel, M., & Willig, J. H. (2014). Gamification as a tool for enhancing graduate medical education. Postgrad Med Journal, 90(1070), 685–693.
63. Nicholson, S. (2015). A RECIPE for meaningful gamification. In L. Wood & T. Reiners (Eds.), Gamification in education and business (pp. 1–20). New York: Springer.
64. Paiva, R., Barbosa, A., Batista, E., Pimentel, D., & Bittencourt, I. (2015). Badges and XP: an observational study about learning. In Frontiers in Education Conference (FIE) (pp. 1–8). doi:10.1109/FIE.2015.7344074.
65. Pedro, L.Z., Lopes, A.M.Z., Prates, B.G., Vassileva, J., & Isotani, S. (2015b). Does Gamification Work for Boys and Girls? An Exploratory Study with a Virtual Learning Environment. In Proceedings of the 30th Annual ACM Symposium on Applied Computing (SAC’15), 214–219, doi:10.1145/2695664.2695752.
66. Pedro, L., Santos, C., Aresta, M., & Almeida, S. (2015a). Peer-Supported Badge Attribution in a Collaborative Learning Platform: The SAPO Campus case. Computers in Human Behavior, 51, 562–567, doi:10.1016/j.chb.2015.03.024.
67. Perry, B. (2015). Gamifying French language learning: a case study examining a quest-based, augmented reality mobile learning tool. Social and Behavioral Sciences, 174, 2308–2315.
68. Pettit, R.K., McCoy, L., Kinney, M., & Schwartz, F.N., (2015). Student Perceptions of Gamified Audience Response System Interactions in Large Group Lectures and via Lecture Capture Technology Approaches to Teaching and Learning. BMC Medical Education, 15(92). doi: 10.1186/s12909-015-0373-7.
69. Poole, S., Kemp, E., Patterson, L., & Williams, K. (2014). Get your head in the game: using gamification in business education to connect with generation Y. Journal for Excellence in Business Education, 3(2), 1–9.
70. Ryan, R. M., Rigby, S. C., & Przybylski, A. (2006). The motivational pull of video games: a self-determination theory approach, Motivation and Emotion, 30, 347–363. Springer Science+Business Media. doi: 10.1007/s11031-006-9051-8
71. Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55, 68–78.
72. Seaborn, K., & Fels, D. I. (2015). Gamification in theory and action: a survey. International Journal of Human Computer Studies, 74, 14–31.
73. Shi, L., Cristea, A. I., Hadzidedic, S., & Dervishalidovic, N. (2014). Contextual gamification of social interaction – towards increasing motivation in social e-learning. In 13th International Conference on Web-based Learning (ICWL2014) (pp. 116–122). Tallinn: Springer. 14–17 August, LNCS 8613.
74. Sillaots, M. (2014). Gamification of higher education by the example of course of research methods. Advances in Web-Based Learning – ICWL, Springer Lecture Notes in Computer Science, 8613, 106–115. Tallinn: Springer Lecture Notes in Computer Science.
75. Sillaots, M. (2015). Gamification of higher education by the example of computer games course. In The Seventh International Conference on Mobile, Hybrid, and On-line Learning (eLmL) (pp. 62–58). Lisbon: IARIA. ISBN 978-1-61208-385-8. Available at http://www.thinkmind.org/index.php?view=article&articleid=elml_2015_4_20_50048. Accessed 17 Jan 2017.
76. Simoes, J., Mateus, S., Redondo, R., & Vilas, A. (2015). An Experiment to Assess Students’ Engagement in a Gamified Social Learning Environment, eLearning Papers, 43, July 2015, DOI: 10.13140/RG.2.1.2384.0488.
77. Smith, E., Herbert, J., Kavanagh, L. & Reidsema, C. (2014). The Effects of Gamification on Student Learning through the Use of Reputation and Rewards within Community Moderated Discussion Boards. AAEE: 24th Annual Conference of the Australasian Association for Engineering Education, Australia, ISBN: 9780992409906. Available at https://espace.library.uq.edu.au/view/UQ:326086/UQ326086.pdf. Accessed 16 Jan 2017.
78. Songer, R. W., & Miyata, K. (2014). A playful affordances model for gameful learning. In TEEM ‘14 2nd International Conference on Technological Ecosystems for Enhancing Multiculturality, Salamanca, Spain (pp. 205–213). doi:10.1145/2669711.2669901.
79. Su, C. H., & Cheng, C. H. (2015). A mobile gamification learning system for improving the learning motivation and achievements. Journal of Computer Assisted Learning, 31(3), 268–286.
80. Tomaselli, F., Sanchez, O., & Brown, S. (2015). How to engage users through gamification: the prevalent effects of playing and mastering over competing. In Thirty Sixth International Conference on Information Systems, Fort Worth (pp. 1–16).
81. Tu, C. H., Yen, C. J., Sujo-Montes, L., & Roberts, G. A. (2015). Gaming personality and game dynamics in online discussion instructions. Educational Media International, 52(3), 155–172. doi:10.1080/09523987.2015.1075099
82. Tulloch, R. (2014). Reconceptualising gamification: play and pedagogy. Digital Culture & Education, 6(4), 317–333.
83. Tvarozek, J., & Brza, T. (2014). Engaging students in online courses through interactive badges. In 2014 International Conference on e-Learning, September 2014, Spain (pp. 89–95). Retrieved from http://elearning-conf.eu/docs/cp14/paper-12.pdf.
84. Utomo, A. Y., & Santoso, H. B. (2015). Development of gamification-enriched pedagogical agent for e-learning system based on community of inquiry. In Proceedings of the International HCI and UX Conference (CHIuXiD’15), Indonesia (pp. 1–9). doi:10.1145/2742032.2742033.
85. Werbach, K. (2014). (Re) Defining gamification: a process approach, persuasive technology. Lecture Notes in Computer Science, 8462, 266–272.
86. Werbach, K., & Hunter, D. (2012). For the win: how game thinking can revolutionize your business. Philadelphia: Wharton Digital Press.
87. Westera, W. (2015). Games are motivating, aren’t they? Disputing the arguments for digital game-based learning. International Journal of Serious Games, 2(2), 3–15. http://dx.doi.org/10.17083/ijsg.v2i2.58.