Factors of problem-solving competency in a virtual chemistry environment: The role of metacognitive knowledge about strategies

Computers and Education

Volumn 59, Issue 4, 2012, Pages 1199-1214

  Scherer, Ronny ^a   Tiemann, Rüdiger ^a  

^a HUMBOLDT UNIVERSITY   (Germany)

Author keywords

Assessment; Complex problem solving; Interactivity; Scientific problem solving; Virtual reality

Indexed keywords

ASSESSMENT; COMPLEX PROBLEM SOLVING; CONFIRMATORY FACTOR ANALYSIS; EMPIRICAL EVIDENCE; GAMING EXPERIENCES; INTERACTIVITY; MEASUREMENT MODEL; METACOGNITIVE KNOWLEDGE; METACOGNITIVES; MODEL FIT; PRIOR KNOWLEDGE; SCIENCE EDUCATION; STATIC PROBLEMS; STRATEGY KNOWLEDGE; THEORETICAL FRAMEWORK;

STUDENTS; VIRTUAL REALITY;

EDUCATION COMPUTING;

EID: 84864073561     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2012.05.020     Document Type: Article

References (79)

1. F. Abd-El-Khalick, S. Boujaoude, R. Duschl, N.G. Lederman, R. Mamlok-Naaman, and A. Hofstein Inquiry in science education: international perspectives Science Education 88 2004 397 419
2. American Association for the Advancement of Science (AAAS) AAAS project 2061 - Science for all Americans 1993 American Association for the Advancement of Science (AAAS) Washington, DC
3. American Educational Research Association (AERA), American Psychological Association (APA), National Council on Measurement in Education (NCME) Standards for educational and psychological testing 2002 AERA Washington, DC
4. E.L. Baker, and H.F. O'Neil Jr. Measuring problem solving in computer environments: current and future states Computers in Human Behavior 18 2002 609 622
5. D.C. Berry, and D.E. Broadbent Interactive tasks and the implicit-explicit distinction British Journal of Psychology 79 1988 251 272
6. C. Blech, and J. Funke You cannot have your cake and eat it, too: how induced goal conflicts affect complex problem solving The Open Psychology Journal 3 2010 42 53
7. T.A. Brown Confirmatory factor analysis for applied research 2006 The Guilford Press New York, NY
8. N.J.S. Brown, and M. Wilson A model of cognition: the missing cornerstone of assessment Educational Psychological Review 23 2011 221 234
9. M. Bühner, S. Kröner, and M. Ziegler Working memory, visual-spatial-intelligence and their relationship to problem-solving Intelligence 36 6 2008 672 680
10. D.P. Cartrette, and G.M. Bodner Non-mathematical problem solving in organic chemistry Journal of Research in Science Teaching 47 6 2010 643 660
11. C.-Y. Chang Does problem solving = prior knowledge + reasoning skills in earth science? An exploratory study Research in Science Education 40 2010 103 116
12. K.-E. Chang, L.-J. Wu, S.-E. Wenig, and Y.-T. Sung Embedding game-based problem-solving phase into problem-posing system for mathematics learning Computers & Education 58 2 2012 775 786
13. C.-H. Chen, and I.-C. Wu The interplay between cognitive and motivational variables in a supportive online learning system for secondary physical education Computers & Education 58 1 2012 542 550
14. B. Choi, and Y. Baek Exploring factors of media characteristic influencing flow in learning through virtual worlds Computers & Education 57 2011 2382 2394
15. J. Cohen Statistical power analysis for behavioral sciences 2nd ed. 1988 Lawrence Erlbaum Hillsdale, NJ
16. M.M. Cooper, and S. Sandi-Urena Design and validation of an instrument to assess metacognitive skillfulness in chemistry problem solving Journal of Chemical Education 86 2 2009 240 245
17. D. Danner, D. Hagemann, D.V. Holt, M. Hager, A. Schankin, and S. Wüstenberg Measuring performance in dynamic decision-making Journal of Individual Differences 32 4 2011 225 233
18. J. De Heer The principle of Le Châtelier and Braun Journal of Chemical Education 34 8 1957 375 380
19. F. Drasgow, and S.C. Chuah Computer-based testing M. Eid, E. Diener, Handbook of multimethod measurement in psychology 2006 American Psychological Association Washington, DC 87 100
20. C. Evans, and N.J. Gibbons The interactivity effect in multimedia learning Computers & Education 49 2007 1147 1160
21. L.B. Flick, and N.G. Lederman Scientific inquiry and nature of science 2006 Springer Dordrecht
22. S. Frahm, M. Goy, K. Kowalski, M. Sixt, R. Strietholt, and I. Blatt Transition and development from lower secondary to upper secondary school Zeitschrift für Erziehungswissenschaft 14 2011 217 232
23. J. Funke Complex problem solving: a case for complex cognition? Cognitive Processing 11 2010 133 142
24. J. Funke, and P.A. Frensch Complex problem solving: the European perspective - 10 years after D.H. Jonassen, Learning to solve complex scientific problems 2007 Lawrence Erlbaum New York/London 25 47
25. D. Gabel, and D.M. Bunce Research on problem solving in chemistry D. Gabel, Handbook of research on teaching and learning science 1994 Macmillan New York 301 326
26. N. Graulich, R. Tiemann, and P.R. Schreiner Heuristic chemistry - a qualitative study on teaching domain-specific strategies for the six-electron case Chemistry Education Research and Practice 2012 10.1039/c1rp90074a
27. D.Z. Hambrick The role of domain knowledge in higher-level cognition O. Wilhelm, R.W. Engle, Handbook of understanding and measuring intelligence 2005 Sage Publications Thousand Oaks, CA 361 372
28. K.A. Heller, and C. Perleth Kognitiver Fähigkeitstest für 4.-12. Klassen, Revision (KFT 4-12+R) Cognitive ability test for grades 4 to 12, revision (KFT 4-12+R) 2000 Hogrefe Göttingen
29. L.-T. Hu, and P.M. Bentler Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives Structural Equation Modeling 6 1999 1 55
30. D.H. Jonassen Learning to solve problems 2011 Taylor & Francis New York, NY
31. A. Jurecka Introduction to the computer-based assessment of competencies J. Hartig, E. Klieme, D. Leutner, Assessment of competencies in educational contexts 2008 Hogrefe & Huber Publishers Cambridge/Göttingen 193 214
32. S. Kalyuga Instructional and testing for expertise: a cognitive load perspective A.M. Columbus, Advances in psychology research Vol. 46 2006 Nova Science Publishers New York 75 127
33. E. Kapa Transfer from structured to open-ended problem solving in a computerized metacognitive environment Learning and Instruction 17 2007 688 707
34. M.C. Kim, and M.J. Hannafin Scaffolding problem solving in technology-enhanced learning environments (TELEs): bridging research and theory with practice Computers & Education 56 2011 403 417
35. B. Kim, H. Park, and Y. Baek Not just fun, but serious strategies: using metacognitive strategies in game-based learning Computers & Education 52 2009 800 810
36. H.J. Kim, and S. Pedersen Advancing young adolescents' hypothesis-development performance in a computer-supported and problem-based learning environment Computers & Education 57 2011 1780 1789
37. E. Klieme, C. Artelt, J. Hartig, N. Jude, O. Köller, and M. Prenzel PISA 2009 2010 Waxmann Münster
38. K. Koeppen, J. Hartig, E. Klieme, and D. Leutner Current issues in competence modeling and assessment Journal of Psychology 216 2 2008 61 73
39. J. Koppelt Modellierung dynamischer Problemlösekompetenz im Chemieunterricht Modeling complex problem solving competency in chemistry 2011 Mensch & Buch Berlin
40. S. Kröner, J.L. Plass, and D. Leutner Intelligence assessment with computer simulations Intelligence 33 4 2005 347 368
41. J. Künsting, J. Wirth, and F. Paas The goal specificity effect on strategy use and instructional efficiency during computer-based scientific discovery learning Computers & Education 56 2011 668 679
42. K.-W. Lee Cognitive variables in problem solving in chemistry Research in Science Education 15 1985 43 50
43. C.B. Lee The interactions between problem solving and conceptual change: system dynamic modelling as a platform for learning Computers & Education 55 2010 1145 1158
44. C.-Y. Lee, and M.-P. Chen A computer game as a context for non-routine mathematical problem solving: the effects of type of question prompt and level of prior knowledge Computers & Education 52 2009 530 542
45. D. Leutner The fuzzy relationship of intelligence and problem solving in computer simulations Computers in Human Behavior 18 2002 685 697
46. D. Leutner, J. Fleischer, J. Wirth, S. Greiff, and J. Funke Analytische und dynamische Problemlösekompetenz im Lichte internationaler Schulleistungsstudien Analytical and dynamic problem solving competencies in large-scale assessments Psychologische Rundschau 63 1 2012 34 42
47. S.T. Levy, and U. Wilensky Mining students' inquiry actions for understanding of complex systems Computers & Education 56 2011 556 573
48. T.D. Little, W.A. Cunnigham, G. Shahar, and K.F. Widaman To parcel or not to parcel: exploring the question, weighing the merits Structural Equation Modeling 9 2 2002 151 173
49. H.W. Marsh, K.-T. Hau, and D. Grayson Goodness of fit in structural equation models A. Maydeu-Olivares, J.J. McArdle, Contemporary psychometrics 2005 Lawrence Erlbaum Mahwah, NJ 275 340
50. R.E. Mayer A taxonomy for computer-based assessment of problem solving Computers in Human Behavior 18 2002 623 632
51. S. Mayonette Online assessment of problem solving skills Computers in Human Behavior 26 2010 1253 1258
52. K.W. McElhaney, and M.C. Linn Investigations of a complex, realistic task: intentional, unsystematic, and exhaustive experimenters Journal of Research in Science Teaching 48 7 2011 745 770
53. S. Messick Validity of psychological assessment: validation of inferences from persons' responses and performances as scientific inquiry into score meaning American Psychologist 50 1995 741 749
54. B.O. Muthén, and L.K. Muthén Mplus 6 [Computer software] 2010 Muthén & Muthén Los Angeles
55. N. Neuenhaus, C. Artelt, K. Lingel, and W. Schneider Fifth graders' metacognitive knowledge: general or domain-specific? European Journal of Psychology of Education 26 2 2010 163 178
56. OECD Reading framework for PISA 2009 (Draft 2) 2007 OECD Paris
57. OECD Problem solving for tomorrow's world - First measures of cross curricular competencies from PISA 2003 2004 OECD Publications Paris
58. OECD PISA 2006 technical report 2009 OECD Paris
59. OECD PISA 2012 field trial problem solving framework - Draft subject to possible revision after the field trial 2010, September Available at http://www.oecd.org/dataoecd/8/42/46962005.pdf Accessed 28.05.12
60. H.A. Pant, A.A. Rupp, S.P. Tiffin-Richards, and O. Köller Validity issues in standard-setting studies Studies in Educational Evaluation 35 2009 95 101
61. S.I. Park, G. Lee, and M. Kim Do students benefit equally from interactive computer simulations regardless of prior knowledge levels? Computers & Education 52 2009 649 655
62. H.J. Pol, E.G. Harskamp, C.J.M. Suhre, and M.J. Goedhart How indirect supportive digital help during and after solving physics problems can improve problem-solving abilities Computers & Education 53 2009 34 50
63. J.T.E. Richardson Eta squared and partial eta squared as measures of effect size in educational research Educational Research Review 6 2011 135 147
64. D. Rickey, and A. Stacy The role of metacognition in learning chemistry Journal of Chemical Education 77 7 2000 915 920
65. J. Sánchez, and R. Olivares Problem solving and collaboration using mobile serious games Computers & Education 57 2011 1943 1952
66. R. Scherer, K. Patzwaldt, and R. Tiemann Covariates of complex problem solving competency in chemistry Science Education Review Letters 1 2011 1 6
67. R. Scherer, and R. Tiemann Erfassung der Struktur und Ausprägung metakognitiven Wissens über Problemlösestrategien im Fach Chemie Assessing the structure and performance of metacognitive knowledge about problem-solving strategies in chemistry S. Bernholt, Konzepte fachdidaktischer Strukturierung für den Unterricht [Concepts of educational structuring for science education] 2012 LIT Berlin 307 309
68. G. Schraw, D.W. Brooks, and K.J. Crippen Using an interactive, compensatory model of learning to improve chemistry teaching Journal of Chemical Education 82 4 2005 637 640
69. U. Schroeders, and O. Wilhelm Computer usage questionnaire: structure, correlates, and gender differences Computers in Human Behavior 27 2011 899 904
70. U. Schroeders, and O. Wilhelm Equivalence of reading and listening comprehension across test media Educational and Psychological Measurement 71 2011 849 869
71. N. Shin, D.H. Jonassen, and S. McGee Predictors of well-structured and ill-structured problem solving in an astronomy simulation Journal of Research in Science Teaching 40 1 2003 6 33
72. G. Taasoobshirazi, and S.M. Glynn College students solving chemistry problems: a theoretical model of expertise Journal of Research in Science Teaching 46 10 2009 1070 1089
73. R. Taconis, and M.G.M. Ferguson-Hessler Teaching science problem solving: an overview of experimental work Journal of Research in Science Teaching 38 4 2001 442 468
74. Thillmann, H. (2007). Selbstreguliertes Lernen durch Experimentieren [Self-regulated learning by experimentation]. Doctoral dissertation, University of Duisburg-Essen, Germany.
75. R. Tiemann, J. Koppelt, and A. Nehring Empirische Fundierung chemiedidaktischer Forschung - Ein Beitrag zum kompetenztheoretischen Ansatz der Problemlöseforschung The empirical foundation of research in chemistry education - a contribution to the modeling of problem solving competencies H. Bayrhuber, U. Harms, B. Muszynski, B. Ralle, M. Rothgangel, L.-H. Schön, Empirische Fundierung in den Fachdidaktiken [Empirical foundation in teaching methodology] 2010 Waxmann Münster/New York 257 274
76. S. Wüstenberg, S. Greiff, and J. Funke Complex problem solving - more than reasoning? Intelligence 40 1 2012 1 14
77. J. Wirth Computer-based tests. Alternatives for test and item design J. Hartig, E. Klieme, D. Leutner, Assessment of competencies in educational contexts 2008 Hogrefe & Huber Publishers Cambridge/Göttingen 235 252
78. J. Wirth, and E. Klieme Computer-based assessment of problem solving competence Assessment in Education: Principles, Policy and Practice 10 3 2004 329 345
79. J.-C. Yen, and C.-Y. Lee Exploring problem solving patterns and their impact on learning achievement in a blended learning environment Computers & Education 56 2011 138 145