The effect of achievement badges on students' behavior: An empirical study in a university-level computer science course

International Journal of Emerging Technologies in Learning

Volumn 10, Issue 1, 2015, Pages 18-29

  Hakulinen, Lasse ^a   Auvinen, Tapio ^a   Korhonen, Ari ^a,b  

^a AALTO UNIVERSITY   (Finland)

^b UNIVERSITY OF TURKU   (Finland)

Author keywords

Achievement badges; E learning; Gamification; Motivation

Indexed keywords

COMPUTER AIDED INSTRUCTION; E-LEARNING; GAMIFICATION; GRADING; MOTIVATION;

ACHIEVEMENT BADGES; COMPUTER SCIENCE COURSE; EMPIRICAL STUDIES; ONLINE LEARNING ENVIRONMENT; STATISTICALLY SIGNIFICANT DIFFERENCE; STUDENTS' BEHAVIORS; TREATMENT GROUP; UNIVERSITY LEVELS;

STUDENTS;

EID: 84924590341     PISSN: 18688799     EISSN: 18630383     Source Type: Journal    
DOI: 10.3991/ijet.v10i1.4221     Document Type: Article

References (36)

1. K. Huotari and J. Hamari, "Defining gamification: A service marketing perspective," in Proceeding of the 16th International Academic MindTrek Conference, ser. MindTrek '12. New York, NY, USA: ACM, 2012, pp. 17-22.
2. C. Muntean, "Raising engagement in e-learning through gamification," in Proceedings of the 6th International Conference on Virtual Learning ICVL, 2011, pp. 323-329.
3. S. Deterding, D. Dixon, R. Khaled, and L. Nacke, "From game design elements to gamefulness: defining "gamification"," in Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, ser. MindTrek '11. New York, NY, USA: ACM, 2011, pp. 9-15.
4. A. Domínguez, J. S. de Navarrete, L. de Marcos, L. Fernández- Sanz, C. Pagés, and J.-J. Martínez-Herráiz, "Gamifying learning experiences: Practical implications and outcomes," Computers & Education, vol. 63, pp. 380-392, 2013. http://dx.doi.org/10.1016/j.compedu.2012.12.020
5. L. de Marcos, A. Domínguez, J. S. de Navarrete, and C. Pagés, "An empirical study comparing gamification and social networking on e-learning," Computers & Education, vol. 75, no. 0, pp. 82-91, 2014. http://dx.doi.org/10.1016/ j.compedu.2014.01.012
6. J. Hamari, J. Koivisto, and H. Sarsa, "Does gamification work? a literature review of empirical studies on gamification," in Proceedings of the 47th Hawaii International Conference on System Sciences, Hawaii, USA, 2014.
7. L. Malmi, V. Karavirta, A. Korhonen, J. Nikander, O. Seppälä, and P. Silvasti, "Visual algorithm simulation exercise system with automatic assessment: TRAKLA2," Informatics in Education, vol. 3, no. 2, pp. 267-288, 2004.
8. L. Hakulinen, T. Auvinen, and A. Korhonen, "Empirical study on the effect of achievement badges in TRAKLA2 online learning environment," in Learning and Teaching in Computing and Engineering (LaTiCE), Macau, 2013, pp. 47-54.
9. S. Abramovich, C. Schunn, and R. M. Higashi, "Are badges useful in education?: it depends upon the type of badge and expertise of learner," Educational Technology Research and Development, vol. 61, no. 2, pp. 217-232, 2013. http://dx.doi.org/10.1007/s11423- 013-9289-2
10. L. Haaranen, P. Ihantola, L. Hakulinen, and A. Korhonen, "How (not) to introduce badges to online exercises," in Proceedings of the 45th ACM Technical Symposium on Computer Science Education, ser. SIGCSE '14. New York, NY, USA: ACM, 2014, pp. 33-38.
11. J. Hamari and V. Eranti, "Framework for designing and evaluating game achievements," in Proceedings of DiGRA 2011 Conference: Think Design Play, Hilversum, Netherlands, 2011.
12. M. Montola, T. Nummenmaa, A. Lucero, M. Boberg, and H. Korhonen, "Applying game achievement systems to enhance user experience in a photo sharing service," in Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era, ser. MindTrek '09. New York, NY, USA: ACM, 2009, pp. 94-97.
13. B. J. Morris, S. Croker, C. Zimmerman, D. Gill, and C. Romig, "Gaming science: the Gamification of scientific thinking," Frontiers in psychology, vol. 4, 2013.
14. J. Henderlong and M. R. Lepper, "The effects of praise on children's intrinsic motivation: a review and synthesis." Psychological bulletin, vol. 128, no. 5, p. 774, 2002. http://dx.doi.org/10.1037/0033-2909.128.5.774
15. A. Decker and E. L. Lawley, "Life's a game and the game of life: How making a game out of it can change student behavior," in Proceeding of the 44th ACM Technical Symposium on Computer Science Education, ser. SIGCSE '13. New York, NY, USA: ACM, 2013, pp. 233-238.
16. P. Denny, "The effect of virtual achievements on student engagement," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI '13. New York, NY, USA: ACM, 2013, pp. 763-772.
17. R. McDaniel, R. Lindgren, and J. Friskics, "Using badges for shaping interactions in online learning environments," in Professional Communication Conference (IPCC), 2012 IEEE International. IEEE, 2012, pp. 1-4.
18. A. Anderson, D. Huttenlocher, J. Kleinberg, and J. Leskovec, "Engaging with massive online courses," in Proceedings of the 23rd International Conference on World Wide Web, ser. WWW '14. Republic and Canton of Geneva, Switzerland: International World Wide Web Conferences Steering Committee, 2014, pp. 687-698.
19. S. Nicholson, "A user-centered theoretical framework for meaningful gamification," in Games+Learning+Society 8.0, Madison, WI, 2012.
20. J. Lee and J. Hammer, "Gamification in education: What, how, why bother?" Academic Exchange Quarterly, vol. 15, no. 2, p. 146, 2011.
21. M. Robertson. (2010, Oct. 6). Can't play, won't play [Online; accessed 15-May-2014]. Available: http://www.hideandseek.net/ 2010/10/06/cant-play-wont-play
22. I. Bogost. (2011, Aug. 8). Gamification is bullshit [Online; accessed 15-May-2014]. Available: http://www.bogost.com/blog/ gamification_is_bullshit.shtml
23. E. L. Deci, R. Koestner, and R. M. Ryan, "Extrinsic rewards and intrinsic motivation in education: Reconsidered once again," Review of Educational Research, vol. 71, no. 1, pp. 1-27, 2001. http://dx.doi.org/10.3102/00346543071001001
24. E. L. Deci and R. M. Ryan, Intrinsic Motivation and Self- Determination in Human Behavior. Plenum, 1985. http://dx.doi.org/10.1007/978-1-4899-2271-7
25. E. D. Mekler, F. Brühlmann, K. Opwis, and A. N. Tuch, "Do points, levels and leaderboards harm intrinsic motivation?: an empirical analysis of common gamification elements," in Proceedings of the First International Conference on Gameful Design, Research, and Applications, ser. Gamification '13. New York, NY, USA: ACM, 2013, pp. 66-73.
26. K. Weaver, S. Garcia, and N. Schwarz, "The presenter's paradox," Journal of Consumer Research, vol. 39, no. 3, pp. 445-460, 2012. http://dx.doi.org/10.1086/664497
27. S. Edwards, "Using software testing to move students from trialand- error to reflection-in-action," ACM SIGCSE Bulletin, vol. 36, no. 1, pp. 26-30, 2004. http://dx.doi.org/10.1145/1028174.971312
28. V. Karavirta, A. Korhonen, and L. Malmi, "On the use of resubmissions in automatic assessment systems," Computer Science Education, vol. 16, no. 3, pp. 229-240, September, 2006. http://dx.doi.org/10.1080/08993400600912426
29. L. Malmi, V. Karavirta, A. Korhonen, and J. Nikander, "Experiences on automatically assessed algorithm simulation exercises with different resubmission policies," Journal of Educational Resources in Computing, vol. 5, no. 3, September, 2005. http://dx.doi.org/10.1145/1163405.1163412
30. N. J. Falkner and K. E. Falkner, "A fast measure for identifying atrisk students in computer science," in Proceedings of the ninth annual international conference on International computing education research. ACM, 2012, pp. 55-62.
31. S. H. Edwards, J. Snyder, M. A. Pérez-Quiñones, A. Allevato, D. Kim, and B. Tretola, "Comparing effective and ineffective behaviors of student programmers," in Proceedings of the fifth international workshop on Computing education research workshop. ACM, 2009, pp. 3-14.
32. J. B. Fenwick Jr, C. Norris, F. E. Barry, J. Rountree, C. J. Spicer, and S. D. Cheek, "Another look at the behaviors of novice programmers," ACM SIGCSE Bulletin, vol. 41, no. 1, pp. 296- 300, 2009. http://dx.doi.org/10.1145/1539024.1508973
33. N. Michinov, S. Brunot, O. L. Bohec, J. Juhel, and M. Delaval, "Procrastination, participation, and performance in online learning environments," Computers & Education, vol. 56, no. 1, pp. 243 -252, 2011. http://dx.doi.org/10.1016/j.compedu.2010.07.025
34. L. Haaranen, L. Hakulinen, P. Ihantola, and A. Korhonen, "Software architectures for implementing achievement badges -practical experiences," in Learning and Teaching in Computing and Engineering (LaTiCE), Kuching, Malaysia, 2014, pp. 41-46.
35. V. Braun and V. Clarke, "Using thematic analysis in psychology," Qualitative Research in Psychology, vol. 3, no. 2, pp. 77-101, 2006. http://dx.doi.org/10.1191/1478088706qp063oa
36. M. Csikszentmihalyi, Flow: The psychology of optimal experience. New York: Harper and Row, 1990.