To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course

Computers and Education

Volumn 118, Issue , 2018, Pages 25-37

  Kyewski, Elias ^a   Krämer, Nicole C ^a  

^a UNIVERSITY OF DUISBURG ESSEN   (Germany)

Author keywords

Badges; e learning; Gamification; Motivation; Social comparison

Indexed keywords

EDUCATION; MOTIVATION; STUDENTS;

BADGES; E-LEARNING COURSE; GAMIFICATION; HIGHER EDUCATION; INTRINSIC MOTIVATION; MOTIVATION AND PERFORMANCE; SOCIAL COMPARISON; SPECIFIC ACTIVITY;

E-LEARNING;

EID: 85034842256     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2017.11.006     Document Type: Article

References (53)

1. Anderson, A., Huttenlocher, D., Kleinberg, J., Leskovec, J., Engaging with massive online courses. Proceedings of the 23rd international conference on World wide web, 2014, April, ACM, 687–698.
2. Barata, G., Gama, S., Jorge, J., Gonçalves, D., Engaging engineering students with gamification. Games and virtual worlds for serious applications (VS-GAMES), Proceedings of the 5th international conference on games and virtual worlds for serious applications, 2013, IEEE, 1–8.
3. Biles, M.L., Plass, J., Homer, B.D., Good badges, evil badges? An empirical inquiry into the impact of digital badge design on goal orientation and learning. Retrieved from http://create.nyu.edu/wordpress/wp-content/uploads/2015/02/HASTAC-Report-Badges-and-Learning-CREATE.pdf, 2014.
4. Boticki, I., Baksa, J., Seow, P., Looi, C.K., Usage of a mobile social learning platform with virtual badges in a primary school. Computers & Education 86 (2015), 120–136, 10.1016/j.compedu.2015.02.015.
5. Brooke, J., System usability scale (SUS): A quick-and-dirty method of system evaluation user information. 1986, Digital Equipment Co Ltd, Reading, UK.
6. Butler, C., A framework for evaluating the effectiveness of gamification techniques by personality type. Nah, F.F., (eds.) HCI in business, 2014, Springer International Publishing, 381–389.
7. Cameron, J., Pierce, W.D., Reinforcement, reward, and intrinsic motivation: A meta-analysis. Review of Educational Research 64 (1994), 363–423, 10.3102/00346543064003363.
8. Codish, D., Ravid, G., Personality based gamification: How different personalities perceive gamification. 2014.
9. Costello, A.B., Osborne, J.W., Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation 10:7 (2005), 1–9.
10. Deci, E.L., Koestner, R., Ryan, R.M., A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin 125 (1999), 627–668 https://doi.org/10.1037/0033-2909.125.6.627.
11. Deci, E.L., Koestner, R., Ryan, R.M., The undermining effect is a reality after all—extrinsic rewards, task interest, and self-determination: Reply to Eisenberger, Pierce, and Cameron (1999) and Lepper, Henderlong, and Gingras (1999). 1999 https://doi.org/10.1037/0033-2909.125.6.692.
12. Deci, E.L., Koestner, R., Ryan, R.M., Extrinsic rewards and intrinsic motivation in education: Reconsidered once again. Review of Educational Research 71 (2001), 1–27, 10.3102/00346543071001001.
13. Deci, E.L., Ryan, R.M., Intrinsic motivation and self-determination in human behavior. 1985, Springer Science & Business Media.
14. Deterding, S., Dixon, D., Khaled, R., Nacke, L., From game design elements to gamefulness: Defining gamification. Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments, 2011, September, ACM, 9–15.
15. Deutsch, M., Gerard, H.B., A study of normative and informational social influences upon individual judgment. The Journal of Abnormal and Social Psychology 51 (1955), 629–636, 10.1037/h0046408.
16. Dijkstra, P., Kuyper, H., van der Werf, G., Buunk, A.P., van der Zee, Y.G., Social comparison in the classroom: A review. Review of Educational Research 78 (2008), 828–879, 10.3102/0034654308321210.
17. Domínguez, A., Saenz-de-Navarrete, J., De-Marcos, L., Fernández-Sanz, L., Pagés, C., Martínez-Herráiz, J.J., Gamifying learning experiences: Practical implications and outcomes. Computers & Education 63 (2013), 380–392, 10.1016/j.compedu.2012.12.020.
18. Eales, R.T., Hall, T., Bannon, L.J., The motivation is the message: Comparing CSCL in different settings. Proceedings of the conference on computer support for collaborative Learning: Foundations for a CSCL community, 2002, January, International Society of the Learning Sciences, 310–317.
19. Fabrigar, L.R., Wegener, D.T., MacCallum, R.C., Strahan, E.J., Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods 4 (1999), 272–299 https://doi.org/10.1037/1082-989X.4.3.272.
20. Festinger, L., A theory of social comparison processes. Human Relations 7 (1954), 117–140, 10.1177/001872675400700202.
21. Filsecker, M., Hickey, D.T., A multilevel analysis of the effects of external rewards on elementary students' motivation, engagement and learning in an educational game. Computers & Education 75 (2014), 136–148 https://doi.org/10.1016/j.compedu.2014.02.008.
22. Fischer, H., Heinz, M., Schlenker, L., Follert, F., Gamifying higher education. Beyond badges, points and leaderboards. Proceedings of the 11th international forum on knowledge asset dynamics, 2016, IFKAD, 15–17.
23. Gibson, D., Ostashewski, N., Flintoff, K., Grant, S., Knight, E., Digital badges in education. Education and Information Technologies 20:2 (2015), 403–410 https://doi.org/10.1007/s10639-013-9291-7.
24. Glover, I., Play as you learn: Gamification as a technique for motivating learners. Herrington, J., Couros, A., Irvine, V., (eds.) Proceedings of world conference on educational multimedia, hypermedia and telecommunications 2013, 2013, AACE, Chesapeake, VA.
25. Haaranen, L., Ihantola, P., Hakulinen, L., Korhonen, A., How (not) to introduce badges to online exercises. Proceedings of the 45th ACM technical symposium on Computer science education, 2014, March, ACM, 33–38.
26. Hakulinen, L., Auvinen, T., Korhonen, A., Empirical study on the effect of achievement badges in TRAKLA2 online learning environment. Proceedings of learning and teaching in computing and engineering (LaTiCE), 2013, 2013, March, IEEE, 47–54.
27. Hamari, J., Do badges increase user activity? A field experiment on the effects of gamification. Computers in Human Behavior 71 (2017), 469–478, 10.1016/j.chb.2015.03.036.
28. Hanus, M.D., Fox, J., Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education 80 (2015), 152–161, 10.1016/j.compedu.2014.08.019.
29. Hayes, A.F., PROCESS: A Versatile Computational Tool for Observed Variable Mediation, Moderation, and Conditional Process Modeling [White paper]. 2012 Retrieved from http://www.afhayes.com/public/process2012.pdf.
30. Huguet, P., Dumas, F., Monteil, J.M., Genestoux, N., Social comparison choices in the classroom: Further evidence for students' upward comparison tendency and its beneficial impact on performance. European Journal of Social Psychology 31 (2001), 557–578, 10.1002/ejsp.81.
31. Khalil, H., Ebner, M., Moocs completion rates and possible methods to improve retention-a literature review. Proceedings of world conference on educational multimedia, hypermedia and telecommunications (vol. 2014, No. 1, pp. 1305–1313), 2014, June.
32. Lohmann, K., Schäffer, J., System usability scale (SUS)–An improved German translation of the questionnaire. Retrieved from http://minds.coremedia.com/2013/09/18/sus-scale-an-improved-german-translation-questionnaire/, 2013.
33. Malzahn, N., Ganster, T., Sträfling, N., Krämer, N., Hoppe, H.U., Motivating students or teachers?. Hernández-Leo, D., Ley, T., Klamma, R., Harrer, A., (eds.) Scaling up learning for sustained impact, 2013, Springer Berlin Heidelberg, 191–204.
34. Mekler, E.D., Brühlmann, F., Opwis, K., Tuch, A.N., Do points, levels and leaderboards harm intrinsic motivation?: an empirical analysis of common gamification elements. Proceedings of the first international conference on gameful design, research and applications, 2013, ACM, 66–73.
35. Mishra, R., Kotecha, K., Students engagement through gamification in education gamifying formative assessment. Journal of Engineering Education Transformations, Mar. 2017, 10.16920/jeet/2017/v0i0/111751 [S.I.], ISSN 2394–1707. Available at: http://www.journaleet.org/index.php/jeet/article/view/111751 (Accessed 20 November 2017).
36. Müller, F.H., Hanfstingl, B., Andreitz, I., Wissenschaftliche Beiträge aus dem Institut für Unterrichts- und Schulentwicklung (IUS) Skalen zur motivationalen Regulation beim Lernen von Schülerinnen und Schülern. Adaptierte und ergänzte Version des Academic Self-Regulation Questionnaire (SRQ-A) nach Ryan & Connell, Vol. 1, 2007.
37. Muntean, C.I., Raising engagement in e-learning through gamification. Proceedings of the 6th international conference on virtual learning ICVL, 2011, October, 323–329.
38. Nicholson, S., A user-centered theoretical framework for meaningful gamification. Games+Learning+Society, 8(1), 2012 Retrieved from http://scottnicholson.com/pubs/meaningfulframework.pdf.
39. O'Donovan, S., Gain, J., Marais, P., A case study in the gamification of a university-level games development course. Proceedings of the South African institute for computer scientists and information technologists conference, 2013, ACM, 242–251.
40. Park, J.H., Choi, H.J., Factors influencing adult learners' decision to drop out or persist in online learning. Journal of Educational Technology & Society 12:4 (2009), 207–217.
41. Pirker, J., Riffnaller-Schiefer, M., Gütl, C., Motivational active learning: Engaging university students in computer science education. Proceedings of the 2014 conference on innovation & technology in computer science education, 2014, June, ACM, 297–302.
42. van Roy, R., Zaman, B., Why gamification fails in education and how to make it successful: Introducing nine gamification heuristics based on Self-Determination Theory. Ma, M., Oikonomou, A., (eds.) Serious games and edutainment applications, 2017, Springer International Publishing, 485–509.
43. Ruipérez-Valiente, J.A., Muñoz-Merino, P.J., Kloos, C.D., Analyzing students' intentionality towards badges within a case study using Khan academy. Proceedings of the sixth international conference on learning analytics & knowledge, 2016, April, ACM, 536–537.
44. Ruipérez-Valiente, J.A., Muñoz-Merino, P.J., Kloos, C.D., An analysis of the use of badges in an educational experiment. Frontiers in education conference (FIE), 2016 IEEE, 2016, October, IEEE, 1–8.
45. Ryan, R.M., Deci, E.L., Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology 25 (2000), 54–67, 10.1006/ceps.1999.1020.
46. Santos, C., Almeida, S., Pedro, L., Aresta, M., Koch-Grunberg, T., Students' perspectives on badges in educational social media platforms: The case of SAPO campus tutorial badges. Advanced learning technologies (ICALT), Proceedings of the 13th international conference on advanced learning technologies, 2013, IEEE, 351–353.
47. Santos, J.L., Charleer, S., Parra, G., Klerkx, J., Duval, E., Verbert, K., Evaluating the use of open badges in an open learning environment. Hernández-Leo, D., Ley, T., Klamma, R., Harrer, A., (eds.) Scaling up learning for sustained impact, 2013, Springer Berlin Heidelberg, 314–327.
48. Seaborn, K., Fels, D.I., Gamification in theory and action: A survey. International Journal of Human-computer Studies 74 (2015), 14–31 https://doi.org/10.1016/j.ijhcs.2014.09.006.
49. Todor, V., Pitică, D., The gamification of the study of electronics in dedicated e-learning platforms. Electronics technology (ISSE), Proceedings of the 36th international spring seminar on, 2013, IEEE, 428–431.
50. Turan, Z., Avinc, Z., Kara, K., Goktas, Y., Gamification and education: Achievements, cognitive loads, and views of students. International Journal of Emerging Technologies in Learning 11 (2016), 64–69 https://doi.org/10.3991/ijet.v11i07.5455.
51. Villagrasa, S., Duran, J., Gamification for learning 3D computer graphics arts. Proceedings of the first international conference on technological ecosystem for enhancing multiculturality, 2013, ACM, 429–433.
52. Zuckerman, O., Gal-Oz, A., Deconstructing gamification: Evaluating the effectiveness of continuous measurement, virtual rewards, and social comparison for promoting physical activity. Personal and Ubiquitous Computing 18 (2014), 1705–1719 https://doi.org/10.1007/s00779-014-0783-2.
53. Zusho, A., Pintrich, P.R., Coppola, B., Skill and will: The role of motivation and cognition in the learning of college chemistry. International Journal of Science Education 25 (2003), 1081–1094, 10.1080/0950069032000052207.