The interplay of game elements with psychometric qualities, learning, and enjoyment in game-based assessment

Computers and Education

Volumn 87, Issue , 2015, Pages 340-356

  Kim, Yoon Jeon ^a   Shute, Valerie J ^b  

^a WORCESTER POLYTECHNIC INSTITUTE   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

Author keywords

Fairness; Game based assessment; Game based learning; Gameplay sequences; Psychometric evaluation; Reliability; Validity

Indexed keywords

RELIABILITY;

FAIRNESS; GAME-BASED; GAME-BASED LEARNING; GAMEPLAY; PSYCHOMETRIC EVALUATION; VALIDITY;

COMPUTER GAMES;

EID: 84938298104     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2015.07.009     Document Type: Article

References (37)

1. N. Abell, D.W. Springer, and A. Kamata Developing and validating rapid assessment instruments 2009 Oxford University Press New York, NY
2. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education Standards for educational and psychological testing 1999 American Educational Research Association Washington, DC
3. R.G. Almond, Y.J. Kim, G. Velasquez, and V.J. Shute Focus article: how task features impact evidence from assessments embedded in simulations and games Measurement: Interdisciplinary Research and Perspectives 12 2014 1 33
4. E.L. Baker, and G.C. Delacruz A framework for the assessment of learning games H.F. O'neil, R.S. Perez, Computer games and team and individual learning 2008 Elsevier Oxford, UK 21 37
5. E. Boyle, and T. Connolly Games for learning: does gender make a difference Proceedings of the 2nd European conference on games based learning 2008 Academic Publishing Limited Reading, UK 69 75
6. M.W. Browne, and R. Cudeck Alternative ways of assessing model fit Sociological Methods & Research 21 2 1992 230 258
7. J. Chen Flow in games (and everything else) Communications of the ACM 50 4 2007 31 34
8. M.W.L. Cheung Constructing approximate confidence intervals for parameters with structural equation models Structural Equation Modeling: A Multidisciplinary Journal 16 2 2009 267 294 10.1080/10705510902751291
9. R.F. DeVellis Scale development: Theory and applications 2nd ed. 2003 Sage Publications Thousand Oaks, CA
10. A. Gabadinho, G. Ritschard, N.S. Müller, and M. Studer Analyzing and visualizing state sequences in R with TraMineR Journal of Statistical Software 40 4 2011 1 37
11. C.S. Green, and D. Bavelier Learning, attentional control, and action video games Current Biology 22 6 2012 197 206 10.1016/j.cub.2012.02.012
12. P.W. Holland, and N.J. Dorans Linking and equating R.L. Brennan, Educational measurement 4th ed. 2006 ACE/Praeger Westpost, CT 187 220
13. P.W. Holland, N.J. Dorans, and N.S. Petersen Equating test scores C.R. Rao, S. Sinharay, Handbook of statistics: Psychometrics 2007 Elsevier Amsterdam, The Netherlands 169 203
14. L.T. Hu, and P.M. Bentler Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives Structural Equation Modeling: A Multidisciplinary Journal 6 1 1999 1 55
15. D.A. Kenny, B. Kaniskan, and D.B. McCoach The performance of RMSEA in models with small degrees of freedom Sociological Methods & Research 2014 1 22
16. C. Klimmt, C. Blake, D. Hefner, P. Vorderer, and C. Roth Player performance, satisfaction, and video game enjoyment S. Natkin, J. Dupire, Proceedings of the 8th international conference on entertainment computing (ICEC 2009) Lecture notes in computer science 5709 2009 Springer Berlin, Germany 1 12
17. C. Klimmt, T. Hartmann, and A. Frey Effectance and control as determinants of video game enjoyment CyberPsychology & Behavior 10 6 2007 845 848 10.1089/cpb.2007.9942
18. K. Lucas, and J.L. Sherry Sex differences in video game play: a communication-based explanation Communication Research 31 5 2004 499 523 10.1177/0093650204267930
19. B. Magerko, C. Heeter, and B. Medler Different strokes for different folks: tapping into the hidden potential of serious games Gaming and Cognition: Theories and Practice from the Learning Sciences 2010 255 280
20. M.E.J. Masson, D.N. Bub, and C.E. Lalonde Video-game training and naïve reasoning about object motion Applied Cognitive Psychology 25 1 2011 166 173 10.1002/acp.1658
21. S. Messick Validity of psychological assessment: validation of inferences from persons' responses and performances as scientific inquiry into score meaning American Psychologist 50 9 1995 741 749 10.1037/0003-066x.50.9.741
22. R.J. Mislevy, J.T. Behrens, K.E. DiCerbo, D.C. Frezzo, and P. West Three things game designers need to know about assessment D. Ifenthaler, D. Eseryel, X. Ge, Assessment in game-based learning: Foundations, innovations, and perspectives 2012 Springer New York, NY 59 81
23. R.J. Mislevy, A. Oranje, M. Bauer, A.A. von Davier, J. Hao, S. Corrigan, and et al. Psychometric considerations in game-based assessment 2014 Institute of Play New York, NY
24. L.K. Muthén, and B.O. Muthén Mplus user's guide 6th ed. 2007 Muthén & Muthén Los Angeles, CA
25. J. Pellegrino, N. Chudowsky, and R. Glaser Knowing what students know: The science and design of educational assessment. National research council's committee on the foundations of assessment 2001 National Academy Press Washington, DC
26. R Core Team R: A language and environment for statistical computing 2013 R Foundation for Statistical Computing Vienna, Austria URL http://www.R-project.org/
27. V.J. Rideout, U.G. Foehr, and D.F. Roberts Generation M2: Media in the lives of 8-to 18-year-olds 2010 The Henry J. Kaiser Family Foundation Menlo Park, CA Retrieved from http://kff.org/other/poll-finding/report-generation-m2-media-in-the-lives/
28. C. Riener, D. Proffitt, and T. Salthouse A psychometric approach to intuitive physics Psychonomic Bulletin & Review 12 4 2005 740 745 10.3758/bf03196766
29. R. Rouse III Game design: Theory and practice 2005 Wordware Publishing Inc Plano, TX
30. R. Ryan, C.S. Rigby, and A. Przybylski The motivational pull of video games: a self-determination theory approach Motivation and Emotion 30 4 2006 344 360 10.1007/s11031-006-9051-8
31. V.J. Shute, and B.J. Becker Prelude: issues and assessment for the 21st century V.J. Shute, B.J. Becker, Innovative assessment for the 21st century: Supporting educational needs 2010 Springer-Verlag New York, NY 1 11
32. V.J. Shute, M. Ventura, M. Bauer, and D. Zapata-Rivera Melding the power of serious games and embedded assessment to monitor and foster learning U. Ritterfeld, M.J. Cody, P. Vorderer, The social science of serious games: Theories and applications 2009 Routledge/LEA Philadelphia, PA 295 321
33. V.J. Shute, M. Ventura, and Y.J. Kim Assessment and learning of qualitative physics in Newton's playground The Journal of Educational Research 106 6 2013 423 430
34. P. Vorderer, T. Hartmann, and C. Klimmt Explaining the enjoyment of playing video games: The role of competition (Paper presented at the Second International Conference on Entertainment Computing, Pittsburgh, PA) 2003
35. L. Warren What do we mean when we say non-linear? 2009, September 18 [Web log post]. Retreived from http://digitalkicks.wordpress.com/2009/09/18/what-do-we-mean-when-we-say-non-linear/
36. Y. Yang, and S.B. Green Coefficient alpha: a reliability coefficient for the 21st century? Journal of Psychoeducational Assessment 29 4 2011 377 392 10.1177/0734282911406668
37. D. Zapata-Rivera, and M. Bauer Exploring the role of games in educational assessment M. Mayrath, J. Clarke-Midura, D. Robinson, G. Shraw, Technology-based assessments for twenty-first-century skills: Theoretical and practical implications from modern research 2012 Information Age Publishing Charlotte, NC 147 169