Gamification of task performance with leaderboards: A goal setting experiment

Computers in Human Behavior

Volumn 71, Issue , 2017, Pages 508-515

  Landers, Richard N ^a   Bauer, Kristina N ^b   Callan, Rachel C ^a  

^a OLD DOMINION UNIVERSITY   (United States)

^b ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Experiment; Gamification; Goal setting theory; Goals; Leaderboard; Quantitative

Indexed keywords

BEHAVIORAL RESEARCH; EXPERIMENTS;

GAMIFICATION; GOAL-SETTING THEORIES; GOALS; LEADERBOARD; QUANTITATIVE;

HUMAN COMPUTER INTERACTION;

EID: 84940094051     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2015.08.008     Document Type: Article

References (47)

1. Burnette, J.L., O'Boyle, E.H., VanEpps, E.M., Pollack, J.M., Finkel, E.J., Mind-sets matter: a meta-analytic review of implicit theories and self-regulation. Psychological Bulletin 139:3 (2013), 655–701, 10.1037/a0029531.
2. Callan, R.C., Bauer, K.N., Landers, R.N., How to avoid the dark side of gamification: ten business scenarios and their unintended consequences. Reiners, T., Wood, L., (eds.) Gamification in education and business, 2015, Springer, Cham, Switzerland, 553–568.
3. Cohen, J., Cohen, P., West, S.G., Aiken, L.S., Applied multiple regression/correlation analysis for the behavioral sciences. 3rd ed., 2003, Lawrence Erlbaum Associates, Mahwah, NJ.
4. Comrey, A.L., Lee, H.B., A first course in factor analysis. 1992, Lawrence Erlbaum, Hillsdale, NJ.
5. Domínguez, A., Saenz-de-Navarrete, J., de-Marcos, L., Fernández-Sanz, L., Pagés, C., Martínez-Herráiz, J.-J., Gamifying learning experiences: practical implications and outcomes. Computers & Education 63 (2013), 380–392, 10.1016/j.compedu.2012.12.020.
6. Eickhoff, C., Harris, C.G., de Vries, A.P., Srinivasan, P., Quality through flow and immersion: Gamifying crowdsourced relevance assessments. Paper presented at the 35th international ACM SIGIR conference on research and development in information retrieval, Portland, Oregon, USA, 2012, August 12–16.
7. Erez, M., Zidon, I., Effect of goal acceptance on the relationship of goal difficulty to performance. Journal of Applied Psychology 69:1 (1984), 69–78, 10.1037/0021-9010.69.1.69.
8. Farzan, R., DiMicco, J.M., Brownholtz, D.R.M.B., Geyer, W., Dugan, C., When the experiment is over: deploying an incentive system to all the users. Paper presented at the symposium on persuasive technology, 2008.
9. Farzan, R., DiMicco, J.M., Millen, D.R., Dugan, C., Geyer, W., Brownholtz, E.A., Results from deploying a participation incentive mechanism within the enterprise. Proceedings of CHI 2008, 2008, 563–572.
10. Frayne, C.A., Geringer, J.M., Self-management training for improving job performance: a field experiment involving salespeople. Journal of Applied Psychology 85:3 (2000), 361–372, 10.1037/0021-9010.85.3.361.
11. Halan, S., Rossen, B., Cendan, J., Lok, B., High score!-Motivation strategies for user participation in virtual human development intelligent virtual agents. 2010, Springer, Berlin/Heidelberg, 482–488.
12. Hamari, J., Transforming homo economicus into homo ludens: a field experiment on gamification in a utilitarian peer-to-peer trading service. Electronic Commerce Research and Applications 12:4 (2013), 236–245, 10.1016/j.elerap.2013.01.004.
13. Hamari, J., Koivisto, J., Pakkanen, T., Do persuasive technologies persuade? A review of empirical studies. Spagnolli, A., Chittaro, L., Gamberini, L., (eds.) Persuasive Technology, LNCS, 8462, 2014, 118–136.
14. Hamari, J., Koivisto, J., Sarsa, H., (2014). Does gamification work? A literature review of empirical studies on gamification. Proceedings of the 47th Hawaii international conference on system sciences, Hawaii, USA, January 6–9, 2014.
15. Hinsz, V.B., The influences of social aspects of competition in goal-setting situations. Current Psychology 24 (2005), 258–273.
16. Hollenbeck, J.R., Klein, H.J., O'Leary, A.M., Wright, P.M., Investigation of the construct validity of a self-report measure of goal commitment. Journal of Applied Psychology 74 (1989), 951–956, 10.1037/0021-9010.74.6.951.
17. Jung, J., Schneider, C., Valacich, J., The effects of real-time individual performance feedback and goal setting on computer-mediated group idea generation. ICIS 2005 Proceedings, 2005, 885–896.
18. Kanfer, R., Ackerman, P.L., Motivation and cognitive abilities: an integrative/aptitude-treatment interaction approach to skill acquisition. Journal of Applied Psychology 74:4 (1989), 657–690, 10.1037/0021-9010.74.4.657.
19. Karoly, P., Mechanisms of self-regulation: a systems view. Annual Review of Psychology 44 (1993), 23–52, 10.1146/annurev.ps.44.020193.000323.
20. Klein, H.J., Wesson, M.J., Hollenbeck, J.R., Alge, B.J., Goal commitment and the goal-setting process: conceptual clarification and empirical synthesis. Journal of Applied Psychology 84 (1999), 885–896, 10.1037/0021-9010.84.6.885.
21. Koivisto, J., Hamari, J., Demographic differences in perceived benefits from gamification. Computers in Human Behavior 35 (2014), 179–188.
22. Koopmans, L., Bernaards, C., Hildebrandt, V., van Buuren, S., van der Beek, A.J., de Vet, H.C.W., Development of an individual work performance questionnaire. International Journal of Productivity and Performance Management 62 (2012), 6–28.
23. Landers, R.N., Developing a theory of gamified learning: linking serious games and gamification of learning. Simulation & Gaming 45 (2015), 752–768.
24. Landers, R.N., Bauer, K.N., Callan, R.C., Armstrong, M.B., Psychological theory and the gamification of learning. Reiners, T., Wood, L., (eds.) Gamification in education and business, 2015, Springer, New York, NY, 165–186.
25. Landers, R.N., Callan, R.C., Casual social games as serious games: The psychology of gamification in undergraduate education and employee training. Ma, M., Oikonomou, A., Jain, L.C., (eds.) Serious games and edutainment applications, 2011, Springer, Surrey, UK, 399–423.
26. Landers, R.N., Landers, A.K., An empirical test of the theory of gamified instructional design: the effect of leaderboards on academic performance. Simulation & Gaming 45 (2015), 769–785.
27. Latham, G.P., Baldes, J.J., The “practical significance” of Locke's theory of goal setting. Journal of Applied Psychology 60:1 (1975), 122–124, 10.1037/h0076354.
28. Latham, G.P., Locke, E.A., Self-regulation through goal setting. Organizational Behavior and Human Decision Processes 50:2 (1991), 212–247, 10.1016/0749-5978(91)90021-k.
29. Lee, F.K., Sheldon, K.M., Turban, D.B., Personality and the goal-striving process: the influence of achievement goal patterns, goal level, and mental focus on performance and enjoyment. Journal of Applied Psychology 88:2 (2003), 256–265, 10.1037/0021-9010.88.2.256.
30. Litchfield, R.C., Brainstorming reconsidered: a goal-based view. Academy of Management Review 33 (2008), 649–668.
31. Litchfield, R.C., Fan, J., Brown, V.R., Directing idea generation using brainstorming with specific novelty goals. Motivation & Emotion 35 (2011), 135–143.
32. Locke, E.A., Toward a theory of task motivation and incentives. Organizational Behavior & Human Performance 3 (1968), 157–189, 10.1016/0030-5073(68)90004-4.
33. Locke, E.A., Relation of goal level to performance with a short work period and multiple goal levels. Journal of Applied Psychology 67:4 (1982), 512–514, 10.1037/0021-9010.67.4.512.
34. Locke, E.A., Latham, G.P., A theory of goal setting & task performance. 1990, Prentice-Hall, Inc, Englewood Cliffs, NJ, US.
35. Locke, E.A., Latham, G.P., Building a practically useful theory of goal setting and task motivation: a 35-year odyssey. American Psychologist 57 (2002), 705–717, 10.1037/0003-066x.57.9.705.
36. Maxwell, S.E., Delaney, H.D., Designing experiments and analyzing data: A model comparison perspective. 2004, Psychology Press, New York, NY.
37. Meade, A.W., Craig, S.B., Identifying careless responses in survey data. Psychological Methods 17 (2012), 437–455, 10.1037/a0028085.
38. Mekler, E.D., Brühlmann, F., Opwis, K., Tuch, A.N., Do points, levels and leaderboards harm intrinsic motivation? an empirical analysis of common gamification elements. Proceedings of the first international conference on gameful design, research, and applications (Gamification ‘13), 2013, 66–73.
39. Moskowitz, G.B., Grant, H., The psychology of goals. 2009, Guilford Press, New York.
40. Nunnally, J.C., Psychometric theory. 2nd ed., 1978, McGraw-Hill, New York.
41. Ordonez, L.D., Schweitzer, M.E., Galinsky, A.D., Bazerman, M.H., Goals gone wild: the systematic side effects of overprescribing goal setting. Academy of Management Perspectives 23 (2009), 6–16.
42. Pedhazur, E.J., Schmelkin, L.P., Measurement, design, and analysis: An integrated approach. 1991, Erlbaum, Hillsadale, NJ.
43. Szymanski, K., Harkins, S.G., Social loafing and self-evaluation with a social standard. Journal of Personality and Social Psychology 53:5 (1987), 891–897, 10.1037/0022-3514.53.5.891.
44. VandeWalle, D., Brown, S.P., Cron, W.L., Slocum, J.W. Jr., The influence of goal orientation and self-regulation tactics on sales performance: a longitudinal field test. Journal of Applied Psychology 84:2 (1999), 249–259, 10.1037/0021-9010.84.2.249.
45. Welsh, D.T., Ordonez, L.D., The dark side of consecutive high performance goals: linking goal setting, depletion, and unethical behavior. Organizational Behavior and Human Decision Processes 123 (2014), 79–89.
46. White, P.H., Kjelgaard, M.M., Harkins, S.G., Testing the contribution of self-evaluation to goal-setting effects. Journal of Personality and Social Psychology 69 (1995), 69–79, 10.1037/0022-3514.69.1.69.
47. Wood, R.E., Mento, A.J., Locke, E.A., Task complexity as a moderator of goal effects: a meta-analysis. Journal of Applied Psychology 72:3 (1987), 416–425, 10.1037/0021-9010.72.3.416.