Computer-generated log-file analyses as a window into students' minds? A showcase study based on the PISA 2012 assessment of problem solving

Computers and Education

Volumn 91, Issue , 2015, Pages 92-105

  Greiff, Samuel ^a   Wüstenberg, Sascha ^a   Avvisati, Francesco ^b  

^a UNIVERSITY OF LUXEMBOURG   (Luxembourg)

^b OECD   (France)

Author keywords

Country specific developments; Cross cultural projects; Interactive learning environments; Interdisciplinary projects; Simulations

Indexed keywords

CLIMATE CONTROL; COMPUTER AIDED ANALYSIS; COMPUTER AIDED INSTRUCTION; EDUCATION; INTERACTIVE COMPUTER SYSTEMS; STUDENTS; TEACHING;

COUNTRY-SPECIFIC DEVELOPMENT; CROSS-CULTURAL PROJECTS; INTERACTIVE LEARNING ENVIRONMENT; INTERDISCIPLINARY PROJECT; SIMULATIONS;

PROBLEM SOLVING;

EID: 84946562449     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2015.10.018     Document Type: Article

References (36)

1. H. Autor, F. Levy, and R.J. Murnane The skill content of recent technological change: an empirical investigation Quarterly Journal of Economics 118 2003 1279 1333
2. V.C. Bunderson, D.K. Inouye, and J.B. Olsen The four generations of computerized educational measurement R.L. Linn, Educational measurement 3rd ed. 1989 Macmillan New York, NY 367 407
3. Z. Chen, and D. Klahr All other things being equal: acquisition and transfer of the control of variables strategy Child Development 70 1999 1098 1120
4. J. Cohen, and P. Cohen Applied multiple regression/correlation analysis for the behavioral sciences 2nd ed. 1983 Lawrence Erlbaum Hillsdale. NJ
5. B. Csapó, J. Ainley, R.E. Bennett, T. Latour, and N. Law Technological issues for computer-based assessment P. Griffin, B. McGaw, E. Care, Assessment and teaching of 21st century skills 2012 Springer Dordrecht
6. Y. Dodonova, and Y. Dodonov Faster on easy items, more accurate on difficult ones: cognitive ability and performance on a task of varying difficulty Intelligence 41 2013 1 10
7. S. Dumais, R. Jeffries, D.M. Russell, D. Tang, and J. Teevan Understanding user behaviour through data and analysis J.S. Olson, W.A. Kellogg, Ways of knowing in HCI 2014 Springer New York 349 372
8. R.G. Floyd, J.L. Evans, and K.S. McGrew Relations between measures of Cattell-Horn-Carroll (CHC) cognitive abilities and mathematics achievement across the school-age years Psychology in the Schools 40 2003 155 171
9. P.A. Frensch, and J. Funke Complex problem solving: The European perspective 1995 Lawrence Erlbaum Associates Hillsdale, NJ
10. A.F. Fry, and S. Hale Processing speed, working memory, and fluid intelligence: evidence for a developmental cascade Psychological Science 7 1996 237 241
11. J. Funke Complex problem solving: a case for complex cognition? Cognitive Processing 11 2010 133 142
12. J. Gobert, M. Sao Pedro, J. Raziuddin, and R. Baker From log-files to assessment metrics for science inquiry using educational data mining Journal of the Learning Sciences 22 2013 521 563
13. F. Goldhammer, J. Naumann, A. Stelter, K. Tóth, H. Rölke, and E. Klieme The time on task effect in reading and problem solving is moderated by task difficulty and skill: insights from a computer-based large-scale assessment Journal of Educational Psychology 106 2014 608 626
14. S. Greiff, S. Wüstenberg, B. Csapo, A. Demetriou, J. Hautamäki, A.C. Graesser, and et al. Domain-general problem solving skills and education in the 21st century Educational Research Review 13 2014 74 83
15. S. Greiff, S. Wüstenberg, G. Molnár, A. Fischer, J. Funke, and B. Csapó Complex problem solving in educational settings - something beyond g: concept, assessment, measurement invariance, and construct validity Journal of Educational Psychology 105 2013 364 379
16. C.D. Güss Fire and ice: testing a model on cultural values and complex problem solving/dynamic decision making Journal of Cross-Cultural Psychology 42 2011 1279 1298
17. D. Ifenthaler, D. Eseryel, and X. Ge Assessment for game-based learning D. Ifenthaler, D. Eseryel, X. Ge, Assessment in game-based learning 2012 Springer Dordrecht
18. S. Kröner, J.L. Plass, and D. Leutner Intelligence assessment with computer simulations Intelligence 33 2005 347 368
19. A. Newell, and H.A. Simon Human problem solving 1972 Prentice-Hall Englewood Cliffs, NJ
20. L.R. Novick, and M. Bassok Problem solving K.J. Holyoak, R.G. Morrison, The Cambridge handbook of thinking and reasoning 2005 University Press Cambridge, NY 321 349
21. OECD PISA data analysis manual: SPSS and SAS 2nd ed. 2009 OECD Publishing Paris
22. OECD Programme for international student assessment: An overview 2009 OECD Paris
23. OECD Better skills, better jobs, better lives: A strategic approach to skills policies 2012 OECD Paris
24. OECD PISA 2012 results: Creative problem solving 2014 OECD Publishing Paris
25. OECD PISA 2012 technical report 2014 OECD Publishing Paris available at: http://www.oecd.org/pisa/pisaproducts/pisa2012technicalreport.htm (Accessed 09.07.15)
26. OECD What students know and can do. Student performance in mathematics, reading and science 2014 OECD Publishing Paris
27. J. Raven Psychometrics, cognitive ability, and occupational performance Review of Psychology 7 2000 51 74
28. C. Romero, S. Ventura, M. Pechenizkiy, and R.S.J.D. Baker Handbook of educational data mining 2011 Chapman & Hall Boca Raton, FL
29. R. Scherer, and R. Tiemann Factors of problem-solving competency in a virtual chemistry environment: the role of metacognitive knowledge about strategies Computers & Education 59 2012 1199 1214
30. F. Schweizer, S. Wüstenberg, and S. Greiff Validity of the MicroDYN approach: complex problem solving predicts school grades beyond working memory capacity Learning & Individual Differences 24 2013 42 52
31. P. Sonnleitner, U. Keller, R. Martin, and M. Brunner Students' complex problem-solving abilities. Their structure and relations to reasoning ability and educational success Intelligence 41 2013 289 305
32. J.E. Tschirgi Sensible reasoning: a hypothesis about hypotheses Child Development 51 1980 1 10
33. D.M. Williamson, R.J. Mislevy, and I.I. Bejar Automated scoring of complex tasks in computer-based testing 2006 Lawrence Erlbaum Hillsdale, NJ
34. J. Wirth, and E. Klieme Computer-based assessment of problem solving competence Assessment in Education 10 2003 329 345
35. S. Wüstenberg, S. Greiff, and J. Funke Complex problem solving - more than reasoning? Intelligence 40 2012 1 14
36. S. Wüstenberg, M. Stadler, J. Hautamäki, and S. Greiff The role of strategy knowledge for the application of strategies in complex problem solving tasks Technology, Knowledge and Learning 19 2014 127 146