In-game assessments increase novice programmers' engagement and level completion speed

ICER 2013 - Proceedings of the 2013 ACM Conference on International Computing Education Research

Volumn , Issue , 2013, Pages 153-160

  Lee, Michael J ^a,b   Ko, Andrew J ^a,b   Kwan, Irwin ^a,b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b OREGON STATE UNIVERSITY   (United States)

Author keywords

Assessment; Engagement, speed, debugging, serious game, educational game; Programming

Indexed keywords

ASSESSMENT; COMPUTING EDUCATION; DESIGN STRATEGIES; EDUCATIONAL SETTINGS; INFORMAL LEARNING; LEARNING SETTINGS; SELF EXPLANATIONS; SERIOUS GAMES;

EDUCATION; LEARNING SYSTEMS; MATHEMATICAL PROGRAMMING;

COMPUTER GAMES;

EID: 84883499948     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2493394.2493410     Document Type: Conference Paper

References (39)

1. Aleven, V, & Koedinger, K.R. (2002). An effective metacognitive strategy: Learning by doing and explaining with a computer-based cognitive tutor. CogSci, 26(2), 147-179.
2. Aleven, V, Myers, E., Easterday, M., & Ogan, A. (2010). Toward a framework for the analysis and design of educational games. IEEEDIGITEL, 69-76.
3. Bjork, R.A. (1999). Assessing our own competence: heuristics and illusions. In Gopher, D., & Koriat, A., Attention and performance XVII: Cognitive regulation of performance, 435-459. Cambridge, MA: MIT Press.
4. Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in education, 5(1), 7-74.
5. Boustedt, J., Eckerdal, A., McCartney, R., Sanders, K., Thomas, L., & Zander C. (2011). Students' perceptions of the differences between formal and informal learning. ACMICER, 61-68.
6. Butler, A.C., & Roediger, H.L. (2008). Feedback enhances the positive effects and reduces the negative effects of multiplechoice testing. Memory & Cognition, 36(3), 604-616. (Pubitemid 351928503)
7. Campbell, J., & Mayer, R.E. (2009). Questioning as an instructional method: Does it affect learning from lectures. Applied Cognitive Psychology, 23, 747-759.
8. Carpenter, S.K., Pashler, H., & VuI, E. (2006). What types of learning are enhanced by a cued recall test? Psychonomic Bulletin & Review, 13, 826-830.
9. Chi, M. T., De Leeuw, N., Chiu, M.H., & LaVancher, C. (1994). Eliciting self-explanations improves understanding. Cognitive Science, 18(3), 439-477.
10. Cross, J. (2006). Informal learning: rediscovering the natural pathways that inspire innovation and performance. San Francisco, CA: Pfeiffer.
11. Csikszentmihalyi, M. (1990). Flow: The psychology of optical experience. New York, NY: Harper Perrennial.
12. Daniel, J. (2012). Making sense of MOOCs: musings in a maze of myth, paradox and possibility. JIME, 3.
13. Eagle, M., & Barnes, T. (2009). Experimental evaluation of an educational game for improved learning in introductory computing. ACMSIGCSEBulletin, 41(1), 321-325.
14. Garris, R., Ahlers, R., & Driskell, J.E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 4, 441-467.
15. Gee, J.P. (2003). What video games have to teach us about learning and literacy. New York, NY: Palgrave Macmillan.
16. Hays, R.T (2005). The effectiveness of instructional games: A literature review and discussion (Technical Report 2005-004). Naval air warfare ctr. training systems division. Orlando, FL.
17. Johnson, C.L, & Mayer, R.E. (2009). A testing effect with multimedia learning. J. Edu. Psychology, 101(3), 621-629.
18. Kapp, K.M. (2012). The gamification of learning and instruction: game-based methods and strategies for training and education. San Francisco, CA: Pfeiffer.
19. Karpicke, J.D., & Roediger, H.L. (2007). Expanding retrieval promotes short-term retention, but equally spaced retrieval enhances long-term retention. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 704-719.
20. Karpicke, J.D., & Roediger, H.L. (2007). Repeated retrieval during learning is the key to long-term retention. Journal of Memory and Language, 57, 151-162.
21. Kehoe, J. (1995). Writing multiple-choice test items. Practical Assessment, Research & Evaluation, 4(9), retrieved April 2013 from http://pareonline.net/getvn.asp?v=4&n=9
22. Lee, M.J., & Ko, AJ. (2011). Personifying programming tool feedback improves novice programmers' learning. ACMICER, 109-116.
23. Lee, M.J., & Ko, A.J. (2012). Investigating the role of purposeful goals on novices' engagement in a programming game. IEEE VL/HCC, 163-166.
24. Malone, T.W. (1981). What makes things fun to learn? a study of intrinsically motivating computer games. Palo Alto, CA: Xerox.
25. McDaniel, MA., Anderson, J.L., Derbish, M.H., & Morrisette, N. (2007). Testing the testing effect in the classroom. European Journal of Cognitive Psychology, 19(4-5), 494-513. (Pubitemid 47026993)
26. McNamara, D., Jackson, G., Graesser, A. (2009) Intelligent tutoring and games. Artificial Intelligence in Education, 1-10.
27. Mislevy, RJ., Behrens, IT., Dicerbo, K.E., Frezzo, D.C., & West, P. (2012). Three things game designers need to know about assessment. Assessment in game-based learning, 59-81.
28. Pear, J.J. (2004). Enhanced feedback using computer-aided personalized system of instruction. In W. Buskist, V. W. Hevern, B.K. Saville, & T. Zinn, (Eds.), Essays from excellence in teaching (Chapter 11).
29. Poehner, M. E. (2007). Beyond the test: L2 dynamic assessment and the transcendence of mediated learning. The Modern Language Journal, 91, 323-340.
30. Randel, IM., Morris, B.A., Wetzel, CD., & Whitehill, B.V. (1992). The effectiveness of games for educational purposes: A review of recent research. Simulation & Gaming, 23(3), 261-276.
31. Riggio, R. E. (2007). Reciprocal peer tutoring: Learning through dyadic teaching. In B. K. Saville, T. E. Zinn, S. A. Meyers, & J. R. Stowell (Eds.), Essays from excellence in teaching, (Chapter 10).
32. Ross, J., Irani, T., Silberman, M. Six, Zaldivar, A., Tomlinson, B. (2010). Who are the crowdworkers?: Shifting demographics in Amazon Mechanical Turk. ACMCHI, 2863-2872.
33. Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119-144.
34. Shute, V.J. (2011). Stealth assessment in computer-based games to support learning. Computer games and instruction, 55(2), 503-524.
35. Shute, V.J., Ventura, M., Bauer, M., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning. Serious games: Mechanisms and Effects, 295-321.
36. Smith, T. (2007). Exams as learning experiences: One nutty idea after another. Beyond Tests and Quizzes: Creative Assessments in the College Classroom, 115, 71.
37. Sweller, J. (2006). The worked example effect and human cognition. Learning and Instruction, 16(2) 165-169.
38. Vrugt, A.J., Langereis, M.P, & IIoogstraten, J.(1997). Academic self-efficacy and malleability of relevant capabilities as predictors of exam performance. Journal of Experimental Education, 66(1), 61-72. (Pubitemid 127374644)
39. Young, J. (2008). "Badges" earned online pose challenge to traditional college diplomas. Chronicle of Higher Education.