Measuring learning in serious games: A case study with structural assessment

Educational Technology Research and Development

Volumn 59, Issue 6, 2011, Pages 741-763

  Wouters, Pieter ^a   van der Spek, Erik D ^a   van Oostendorp, Herre ^a  

^a UTRECHT UNIVERSITY   (Netherlands)

Author keywords

Complex skills; Knowledge structures; Serious games; Structural assessment; Verbal assessment

Indexed keywords

EID: 81455132230     PISSN: 10421629     EISSN: 15566501     Source Type: Journal    
DOI: 10.1007/s11423-010-9183-0     Document Type: Article

References (30)

1. Acton, W. H., Johnson, P. J., & Goldsmith, T. E. (1994). Structural knowledge assessment: Comparison of referent structures. Journal of Educational Psychology, 86, 303-311.
2. Adelson, B. (1981). Problem solving and the development of abstract categories in programming languages. Memory and Cognition, 9, 422-433.
3. Biglan, A. (1973). The characteristics of subject matter in different academic areas. Journal of Applied Psychology, 57, 204-213.
4. Boshuizen, H. P. A., & Schmidt, H. G. (1992). On the role of biomedical knowledge in clinical reasoning by experts, intermediates and novices. Cognitive Science, 16, 153-184.
5. Day, E. A., Arthur, W., Jr., & Gettman, D. (2001). Knowledge structures and the acquisition of a complex skill. Journal of Applied Psychology, 86, 1022-1033.
6. Dayton, T., Durso, F. T., & Shepard, J. D. (1990). A measure of the knowledge reorganization underlying insight. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 267-277). Norwood, NJ: Ablex.
7. Diekhoff, G. M. (1983). Testing through relationship judgments. Journal of Educational Psychology, 75, 227-233.
8. Dorsey, D. W., Campbell, G. E., Foster, L. L., & Miles, D. E. (1999). Assessing knowledge structures: Relations with experience and posttraining performance. Human Performance, 12, 31-57.
9. Glaser, R., & Chi, M. T. (1989). Overview. In M. T. Chi, R. Glaser, & M. J. Farr (Eds.), The nature of expertise (pp. xv-xxviii). Hillsdale, NJ: Lawrence Erlbaum Associates.
10. Goldsmith, T. E., & Johnson, P. J. (1990). A structural assessment of classroom learning. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 241-254). Norwood, NJ: Ablex.
11. Goldsmith, T. E., Johnson, P. J., & Acton, W. H. (1991). Assessing structural knowledge. Journal of Educational Psychology, 83, 88-96.
12. Gonzalvo, P., Cañas, J. J., & Baja, M.-T. (1994). Structural representations in knowledge acquisition. Journal of Educational Psychology, 86, 601-618.
13. Hustinx, P., Meeuwis, D., & Hermans, R. (2002). Geneeskundig management bij grootschalige incidenten (Major incident medical management and support: The practical approach). The Netherlands, Utrecht: De Tijdstroom.
14. Jonassen, D. H. (1988). Designing structured hypertext and structuring access to hypertext. Educational Technology, 28, 13-16.
15. Jonassen, D. H., Beissner, K., & Yacci, M. (1993). Structural knowledge: Techniques for representing, conveying, and acquiring structural knowledge. Hillsdale, NJ: Lawrence Erlbaum Associates.
16. Keppens, J., & Hay, D. (2008). Concept map assessment for teaching computer programming. Computer Science Education, 18, 31-42.
17. Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78, 311-328.
18. Kraiger, K., Salas, E., & Cannon-Bowers, J. A. (1995). Measuring knowledge organization as a method for assessing learning during training. Human Factors, 37, 804-816.
19. McDonald, J. E., Paap, K. R., & McDonald, D. R. (1990). Hypertext perspectives: Using pathfinder to build hypertext systems. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 197-211). Norwood, NJ: Ablex.
20. McGaghie, W. C., McCrimmon, D. R., Mitchell, G., Thompson, J. A., & Ravitch, M. M. (2000). Quantative concept mapping in pulmonary physiology: Comparison of student and faculty knowledge structures. Advances in Physiology Education, 23, 72-81.
21. Messick, S. (1984). Abilities and knowledge in educational achievement testing: The assessment of dynamic cognitive structures. In B. S. Blake (Ed.), Social and technical issues in testing: Implications for test construction and usage (pp. 156-172). Hillsdale, NJ: Lawrence Erlbaum Associates.
22. Nash, J. G., Bravaco, R. J., & Simonson, S. (2006). Assessing knowledge change in computer science. Computer Science Education, 16, 37-51.
23. Pirnay-Dummer, P., Ifenthaler, D., & Spector, J. (2010). Highly integrated model assessment technology and tools. Educational Technology Research and Development, 58, 3-18.
24. Schvaneveldt, R. W., Durso, F. T., & Dearholt, D. W. (1985). Pathfinder: Scaling with network structures. Las Cruses: (Memorandum in Computer and Cognitive Science, MCCS-85-9, Computing Research Laboratory), New Mexico State University.
25. Shuell, T. J. (1990). Phases of meaningful learning. Review of Educational Research, 60, 531-547.
26. Sternberg, R. J. (1989). Domain-generality versus domain-specificity: The life and impending death of a false dichotomy. Merill-Palmer Quarterly, 35, 115-129.
27. Trumpower, D. L., Sharara, H., & Goldsmith, T. E. (2010). Specificity of structural assessment of knowledge. The Journal of Technology, Learning, and Assessment, 8(5), 1-31. Retrieved April 8, 2010 from http://escholarship. bc. edu/cgi/viewcontent. cgi?article=1238& context=jtla.
28. van der Spek, E. D., van Oostendorp, H., Wouters, P., & Aarnoudse, L. (2010). Attentional cueing in serious games. In K. Debattista, M. Dickey, A. Proença, & L. P. Santos (Eds.), 2010 second international conference on games and virtual worlds for serious applications (pp. 119-125). Los Alamitos, CA: IEEE.
29. van der Spek, E. D., Wouters, P., & van Oostendorp, H. (in press). Code Red: Triage or cognition-based design rules enhancing decionmaking training in a game environment. British Journal of Educational Technology.
30. Wouters, P., van der Spek, E. D., & van Oostendorp, H. (2009). Current practices in serious game research: A review from a learning outcomes perspective. In T. M. Connolly, M. Stansfield, & L. Boyle (Eds.), Games-based learning advancements for multisensory human computer interfaces: Techniques and effective practices (pp. 232-255). Hershey, PA: IGI Global.