Measuring the (dis-)similarity between expert and novice behaviors as serious games analytics

Education and Information Technologies

Volumn 20, Issue 1, 2015, Pages 5-19

  Loh, Christian Sebastian ^a   Sheng, Yanyan ^a  

^a SOUTHERN ILLINOIS UNIVERSITY   (United States)

Author keywords

Information Trails ; Performance metrics; Serious games analytics (SEGA); Serious games assessment; String similarity

Indexed keywords

EID: 84878491139     PISSN: 13602357     EISSN: 15737608     Source Type: Journal    
DOI: 10.1007/s10639-013-9263-y     Document Type: Article

References (41)

1. Bellotti, F., Kapralos, B., Lee, K., Moreno-Ger, P., & Berta, R. (2013). Assessment in and of Serious Games: an overview. Advances in Human-Computer Interaction, 2013, 11. doi:10.1155/2013/136864.
2. Bilenko, M., & Mooney, R. J. (2003). Adaptive duplicate detection using learnable string similarity measures. Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2003) (pp. 39–48). Washington DC. Retrieved from http://www.isi.edu/info-agents/courses/csci548/Papers/marlin-kdd-03.pdf
3. Boot, W. R., Kramer, A. F., Simons, D. J., Fabiani, M., & Gratton, G. (2008). The effects of video game playing on attention, memory, and executive control. Acta Psychologica, 129(3), 387–398. doi:10.1016/j.actpsy.2008.09.005. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/18929349
4. Canossa, A., Seif El-Nasr, M., & Drachen, A. (2013) Benefits of game analytics: Stakeholders, contexts and domains. In M. Seif El-Nasr, A. Drachen, & A. Canossa (Eds.), Games Analytics: maximizing the value of player data (pp. 41–52). London, UK: Springer-Verlag. doi:10.1007/978-1-4471-4769-5.
5. Chamberlain, T. C., Catano, V. M., & Cunningham, D. P. (2005). Personality as a predictor of professional behavior in dental school: Comparisons with dental practitioners. Journal of Dental Education, 69(11), 1222–1237. Retrieved from http://www.jdentaled.org/cgi/content/abstract/69/11/1222
6. Clark, R. E. (1985). Confounding in educational computing research. Journal of Educational Computing Research, 1(2), 137–148.
7. Dreyfus, S. E. (2004). The five-stage model of adult skill acquisition. Bulletin of Science Technology Society, 24(3), 177–181. doi:10.1177/0270467604264992.
8. Dreyfus, S. E., & Dreyfus, H. L. (1980). A five-stage model of the mental activities involved in directed skill acquisition (p. 18). Report No. ORC-80-2. Berkeley, CA: Operation Research Center. Retrieved from http://www.dtic.mil/cgi-bin/GetTRDoc?AD=ADA084551&Location=U2&doc=GetTRDoc.pdf
9. Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (2006). The Cambridge handbook of expertise and expert performance (p. 901). New York: Cambridge University Press.
10. Fletcher, G. H. (2013). New Initiatives Aim to Make School Data Interoperable. T.H.E. Journal, 40(4), 31–34. Retrieved from http://thejournal.com/articles/2013/04/23/new-initiatives-aim-to-make-school-data-interoperable.aspx
11. Hastings, N. B., & Tracey, M. W. (2004). Does media affect learning: where are we now? TechTrends, 49(2), 28–30. doi:10.1007/BF02773968.
12. Hofer, A. (2011). Exploratory comparison of expert and novice pair programmers. In Z. Huzar, R. Koci, B. Meyer, B. Walter, & J. Zendulka (Eds.), Software Engineering Techniques (vol. 4980, pp. 218–231). Berlin, Heidelberg: Springer Berlin Heidelberg. doi:10.1007/978-3-642-22386-0_17.
13. Hogarth, R. M., & Karelaia, N. (2008). Skill, luck, overconfidence, and risk taking. (Online). Rochester, NY: Social Science Electronic Publishing, Inc. doi:10.2139/ssrn.1374235.
14. Hughes, P. (2002). Can we improve on how we select medical students? Journal of the Royal Society of Medicine, 95(1), 18–22. doi:10.1258/jrsm.95.1.18.
15. Ifenthaler, D., Eseryel, D., & Ge, X. (2012). Assessment in Game-based Learning: Foundations, Innovations, and Perspectives (p. 465). New York: Springer.
16. Jonassen, D. H., Hannum, W. H., & Tessmer, M. (1989). Handbook of Task Analysis Procedures (p. 410). Westport: Praeger Publishers.
17. Lachenbruch, P. A., & Mickey, M. R. (1968). Estimation of error rates in discriminant analysis. Technometrics, 10(1), 1–11. Retrieved from http://www.jstor.org/stable/1266219
18. Law, B., Atkins, M. S., Kirkpatrick, A. E., & Lomax, A. J. (2004). Eye gaze patterns differentiate novice and experts in a virtual laparoscopic surgery training environment. In Proceedings of the Eye Tracking Research & Applications Symposium - ETRA 2004 (pp. 41–48). New York: ACM Press. doi:10.1145/968363.968370.
19. Levenshtein, V. I. (1966). Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics-Doklady, 10(8), 707–710.
20. Loh, C. S. (2009). Researching and developing serious games as interactive learning instructions. International Journal of Gaming and Computer-Mediated Simulations, 1(4), 1–19. doi:10.4018/jgcms.2009091501.
21. Loh, C. S. (2012). Information Trails: In-process assessment of game-based learning. In D. Ifenthaler, D. Eseryel, & X. Ge (Eds.), Assessment in Game-based Learning: Foundations, Innovations, and Perspectives (pp. 123–144). New York: Springer. doi:10.1007/978-1-4614-3546-4.
22. Loh, C. S. (2013). Improving the impact and return of investment of game-based learning. International Journal of Virtual and Personal Learning Environments 4(1), 1–15. doi:10.4018/jvple.2013010101.
23. Loh, C. S., Anantachai, A., Byun, J. H., & Lenox, J. (2007). Assessing what players learned in serious games: in situ data collection, Information Trails, and quantitative analysis. In Q. Mehdi (Ed.), Proceedings of the Computer Games: AI, Animation, Mobile, Educational & Serious Games Conference (CGAMES 2007). Wolverhampton: University of Wolverhampton.
24. Louis, S. J., & Miles, C. (2005). Playing to learn: case-injected genetic algorithms for learning to play computer games. Evolutionary Computation, IEEE Transactions on, 9(6), 669–681. doi:10.1109/TEVC.2005.856209.
25. Monge, A. E., & Elkan, C. P. (1997). An efficient domain-independent algorithm for detecting approximately duplicate database records. In Proceedings of the SIGMOD 1997 Workshop on Research Issues on Data Mining and Knowledge Discovery (pp. 23–29). New York: ACM.
26. Moura, D., Seif el-Nasr, M., & Shaw, C. D. (2011). Visualizing and understanding players’ behavior in video games: Discovering patterns and supporting aggregation and comparison. In Proceedings of the 2011 ACM SIGGRAPH Symposium on Video Games (pp. 11–15). New York: ACM Press. doi:10.1145/2037692.2037695.
27. Prensky, M., & Bowers, J. C. (2005). Serious games debate. Serious Games Summit. Washington, DC.
28. R Core Team. (2012). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.r-project.org
29. Rao, R. (2003). From unstructured data to actionable intelligence. IT Professional, 5(6), 29–35. doi:10.1109/MITP.2003.1254966.
30. Rockoff, J. E., Jacob, B. A., Kane, T. J., & Staiger, D. O. (2008, November 13). Can you recognize an effective teacher when you recruit one? Cambridge, MA: National Bureau of Economic Research. Retrieved from http://www.nber.org/papers/w14485.pdf
31. Rubin, J., & Watson, I. (2010). Similarity-based retrieval and solution re-use policies in the game of Texas Hold’em. In I. Bichindaritz & S. Montani (Eds.), Case-based reasoning, research and development (vol. 6176, pp. 465–479). Berlin, Heidelberg: Springer Berlin Heidelberg. doi:10.1007/978-3-642-14274-1.
32. Seif El-Nasr, M., Drachen, A., & Canossa, A. (Eds.). (2013). Game analytics: Maximizing the value of player data (p. 815). London: Springer. doi:10.1007/978-1-4471-4769-5.
33. Shute, V. J., Masduki, I., Donmez, O., Dennen, V. P., Kim, Y.-J., Jeong, A. C., et al. (2010). Modeling, Assessing, and Supporting Key Competencies Within Game Environments. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-Based Diagnostics and Systematic Analysis of Knowledge (pp. 281–309). Boston, MA: Springer US. doi:10.1007/978-1-4419-5662-0_15. Retrieved from http://www.springerlink.com/content/t5261055733n18h2/
34. Siemens, G., Gasevic, D., Haythornthwaite, C., Dawson, S., Shum, S. B., Ferguson, R., et al. (2011). Open learning analytics: An integrated & modularized platform. Beaumont, Alberta: Society for Learning Analytics Research (SOLAR). Retrieved from http://solaresearch.org/OpenLearningAnalytics.pdf
35. Thomas, J. M., & DeRosier, M. E. (2010). Toward effective game-based social skills tutoring for children: an evaluation of a social adventure game. Proceedings of the 5th International Conference on the Foundations of Digital Games (FDG ’10). (pp. 217–223). Monterey, CA: ACM.
36. Underwood, J. (2005). Novice and expert performance with a dynamic control task: Scanpaths during a computer game. In G. Underwood (Ed.), Cognitive processes in eye guidance (pp. 303–323). Oxford: Oxford University Press. doi:10.1093/acprof:oso/9780198566816.003.0013.
37. Van Eck, R. (2006). Digital game-based learning: It’s not just the digital natives who are restless…. EDUCAUSE Review, 41(2), 16–30. Retrieved from http://www.educause.edu/ir/library/pdf/ERM0620.pdf
38. White, J. W., & Ruttenberg, B. I. (2007). Discriminant function analysis in marine ecology: some oversights and their solutions. Marine Ecology Progress Series, 329, 301–305. doi:10.3354/meps329301.
39. Williams, A. M., & Ford, P. R. (2008). Expertise and expert performance in sport. International Review of Sport and Exercise Psychology, 1(1), 4–18. doi:10.1080/17509840701836867.
40. Winkler, W. E. (1999). The state of record linkage and current research problems (p. 15). Washington, DC: Bureau of the Census. Retrieved from http://www.census.gov/srd/papers/pdf/rr99-04.pdf
41. Zoeller, G. (2010). Development Telemetry in Video Games Projects. Game Developer Conference 2010. San Francisco, CA. Retrieved from http://gdc.gulbsoft.org/talk