Using gameplay data to examine learning behavior patterns in a serious game

Computers in Human Behavior

Volumn 72, Issue , 2017, Pages 757-770

  Kang, Jina ^a   Liu, Min ^a   Qu, Wen ^b  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b UNIVERSITY OF NOTRE DAME   (United States)

Author keywords

Learning behavior; Learning process; Middle school science; Pattern mining; Problem solving; Serious games analytics

Indexed keywords

DATA MINING; EDUCATION; STUDENTS;

LEARNING BEHAVIOR; LEARNING PROCESS; MIDDLE SCHOOL SCIENCE; PATTERN MINING; SERIOUS GAMES;

PROBLEM SOLVING;

EID: 85005842145     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2016.09.062     Document Type: Article

References (41)

1. Agrawal, R., Srikant, R., Mining sequential patterns. Proceedings of the eleventh IEEE international conference on data engineering (ICDE), 1995, 3–14 (Taipei, Taiwan).
2. Bakeman, R., Gottman, J.M., Observing interaction: An introduction to sequential analysis. 2nd ed., 1997, Cambridge University Press, UK.
3. Barab, S.A., Scott, B., Siyahhan, S., Goldstone, R., Ingram-Goble, A., Zuiker, S.J., et al. Transformational play as a curricular scaffold: Using videogames to support science education. Journal of Science Education and Technology 18 (2009), 305–320.
4. Bland, J.M., Altman, D.G., Multiple significance tests: The Bonferroni. 1995.
5. Brown, A.L., Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. The Journal of the Learning Sciences 2:2 (1992), 141–178, 10.1207/s15327809jls0202_2.
6. Chi, M.T.H., Feltovich, P., Glaser, R., Categorization and representation of physics problems by experts and novices. Cognitive Science 5 (1981), 121–152.
7. Clarke-Midura, J., Dede, C., Norton, J., The road ahead for state assessments. 2011, Policy Analysis for California Education and Rennie Center for Educational Research & Policy, Cambridge, MA.
8. Clark, D.B., Martinez-Garza, M.M., Biswas, G., Luecht, R.M., Sengupta, P., Driving assessment of students' explanations in game dialog using computer-adaptive testing and hidden Markov Modeling. Ifenthaler, D., Eseryel, D., Xun, G., (eds.) Game-based learning: Foundations, innovations, and perspectives, 2012, Springer, New York, 173–199.
9. Cobb, P., Confrey, J., diSessa, A., Lehrer, R., Schauble, L., Design experiments in educational research. Educational Researcher 32:1 (2003), 9–13.
10. Dreyfus, S.E., The five-stage model of adult skill acquisition. Bulletin of Science, Technology and Society 24:3 (2004), 177–181, 10.1177/0270467604264992.
11. Dreyfus, H.L., Dreyfus, S.E., Peripheral vision: Expertise in real world contexts. Organization Studies 26:5 (2005), 779–792, 10.1177/0170840605053102.
12. Foundation of American Scientists, Summit on educational games: Harnessing the power of video games for learning. 2006 Washington, DC.
13. Gick, M.L., Problem-solving strategies. Educational Psychologist 21 (1986), 99–120.
14. Glaser, R., The maturing of the relationship between the science of learning and cognition and educational practice. Learning and Instruction 1:2 (1991), 129–144.
15. Hou, H.-T., Integrating cluster and sequential analysis to explore learners' flow and behavioral patterns in a simulation game with situated-learning context for science courses: A video-based process exploration. Computers in Human Behavior 48 (2015), 424–435, 10.1016/j.chb.2015.02.010.
16. Jonassen, D.H., Toward a design theory of problem-solving. Educational Technology Research and Development 48:4 (2000), 63–85, 10.1007/bf02300500.
17. Kang, J., Liu, M., Liu, S., Tracking students' activities in serious games. Lai, F.-Q., Lehman, J.D., (eds.) Learning and knowledge analytics in open education, 2017, Springer International Publishing, 125–137 Retrieved from http://link.springer.com/chapter/10.1007/978-3-319-38956-1_10.
18. Liu, M., Bera, S., An analysis of cognitive tool use patterns in a hypermedia learning environment. Educational Technology Research and Development 53:1 (2005), 5–21, 10.1007/BF02504854.
19. Liu, C.C., Cheng, Y.B., Huang, C.W., The effect of simulation games on the learning of computational problem solving. Computers and Education 57:3 (2011), 1907–1918.
20. Liu, M., Horton, L.R., Corliss, S.B., Svinicki, M.D., Bogard, T., Kim, J., Chang, M., Students' problem solving as mediated by their cognitive tool use: A study of tool use patterns. Journal of Educational Computing Research 40:1 (2009), 111–139.
21. Liu, M., Horton, L., Kang, J., Kimmons, R., Lee, J., Using a ludic simulation to make learning of middle school space science fun. The International Journal of Gaming and Computer-Mediated Simulations 5:1 (2013), 66–86, 10.4018/jgcms.2013010105.
22. Liu, M., Horton, L., Olmanson, J., Toprac, P., A study of learning and motivation in a new media enriched environment for middle school science. Educational Technology Research and Development, 2011, 1–17.
23. Liu, M., Kang, J., Lee, J., Winzeler, E., Liu, S., Examining through visualization what tools learners access as they play a serious game for middle school science. Loh, C.S., Sheng, Y., Ifenthaler, D., (eds.) Serious games analytics: methodologies for performance measurement, assessment, and improvement, 2015, Springer, Switzerland, 181–208, 10.1007/978-3-319-05834-4.
24. Liu, M., Lee, J., Kang, Liu, S., What we can learn from the data: A multiple-case study examining behavior patterns by students with different characteristics in using a serious game. The Technology, Knowledge and Learning Journal 21:1 (2016), 33–57, 10.1007/s10758-015-9263-7.
25. Liu, M., Wivagg, J., Geurtz, R., Lee, S.-T., Chang, H.M., Examining how middle school science teachers implement a multimedia-enriched problem-based learning environment. Interdisciplinary Journal of Problem-Based Learning 6:2 (2012), 46–84.
26. Loh, C.S., Information trails: In-process assessment of game-based learning. Ifenthaler, D., Eseryel, D., Ge, X., (eds.) Assessment in game-based learning: Foundations, innovations, and perspectives, 2012, Springer, New York, 123–144, 10.1007/978-1-4614-3546-4.
27. Loh, C.S., Sheng, Y., Maximum similarity index (MSI): A metric to differentiate the performance of novices vs. multiple-experts in serious games. Computers in Human Behavior 39 (2014), 322–330.
28. Loh, C.S., Sheng, Y., Measuring expert performance for serious games analytics: From data to insights. Loh, C.S., Sheng, Y., Ifenthaler, D., (eds.) Serious games analytics: Methodologies for performance measurement, assessment, and improvement, 2015, Springer, Switzerland, 101–134, 10.1007/978-3-319-05834-4.
29. Loh, C.S., Sheng, Y., Ifenthaler, D., Serious games analytics: Theoretical framework. Loh, C.S., Sheng, Y., Ifenthaler, D., (eds.) Serious games analytics: Methodologies for performance measurement, assessment, and improvement, 2015, Springer, Switzerland, 3–29, 10.1007/978-3-319-05834-4.
30. van Merriënboer, J.J., Perspectives on problem-solving and instruction. Computers & Education 64 (2013), 153–160, 10.1016/j.compedu.2012.11.025.
31. National Research Council, National science Education Standard. 1996, The National Academies Press, Washington, DC.
32. Pei, J., Han, J., Wang, W., Constraint-based sequential pattern mining: The pattern-growth methods. Journal of Intelligent Information Systems 28:2 (2007), 133–160, 10.1007/s10844-006-0006-z.
33. Quellmalz, E., Timms, M., Schneider, S., Assessment of student learning in science simulations and games. Proceedings of the Workshop on learning science: Computer games, simulations, and education, 2009, National Academy of Sciences, Washington, DC.
34. th ed., 2011, Human Kinetics, Champaign, IL.
35. Squire, K., Open-ended video games: A model for developing learning for the interactive age. Salen, K., (eds.) The ecology of games: Connecting youth, games, and learning, 2008, The MIT Press, Cambridge, MA, 167–198.
36. Wallner, G., Kriglstein, S., Visualization-based analysis of gameplay data—A review of literature. Entertainment Computing 4:3 (2013), 143–155, 10.1016/j.entcom.2013.02.002.
37. Wang, F., Hannafin, M.J., Design-based research and technology-enhanced learning environments. Educational Technology Research and Development 53:4 (2005), 5–23.
38. Wiley, J., Expertise as mental set: The effects of domain knowledge in creative problem solving. Memory and Cognition 26:4 (1998), 716–730.
39. Zaki, M., Scalable algorithms for association mining. IEEE Transactions on Knowledge and Data Engineering 12:3 (2000), 372–390.
40. Zaki, M., SPADE: An efficient algorithm for mining frequent sequences. Machine Learning 40 (2001), 31–60.
41. Zhou, M., Xu, Y., Nesbit, J.C., Winne, P.H., Sequential pattern analysis of learning logs: Methodology and applications. Romero, C., et al. (eds.) Handbook of educational data mining, 2010, Chapman & Hall/CRC Press, 107–121.