Evidence on the effects of task interactivity and grade level on thinking skills involved in complex problem solving

Thinking Skills and Creativity

Volumn 11, Issue , 2014, Pages 48-64

  Scherer, Ronny ^a   Tiemann, Rüdiger ^a  

^a HUMBOLDT UNIVERSITY   (Germany)

Author keywords

Computer based assessment; Problem solving; Scientific reasoning; Task interactivity

Indexed keywords

EID: 84890141527     PISSN: 18711871     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tsc.2013.10.003     Document Type: Article

References (88)

1. Abd-El-Khalick F., Boujaoude S., Duschl R., Lederman N.G., Mamlok-Naaman R., Hofstein A., et al. Inquiry in science education: International perspectives. Science Education 2004, 88:397-419.
2. Albert D., Steinberg L. Age differences in strategic planning as indexed by the Tower of London. Child Development 2011, 82:1501-1517.
3. Alibali M.W., Phillips K.M.O., Fischer A.D. Learning new problem-solving strategies leads to changes in problem representation. Cognitive Development 2009, 24:89-101.
4. Amsel E., Klaczynski P.A., Johnston A., Bench S., Close J., Sadler E., et al. A dual-process account of the development of scientific reasoning: The nature and development of metacognitive intercession skills. Cognitive Development 2008, 23:452-471.
5. Avargil S., Herscovitz O., Dori Y.J. Challenges in the transition to large-scale reform in chemical education. Thinking Skills and Creativity 2013, 10.1016/j.tsc.2013.07.008.
6. Baker E.L., O'Neil H.F. Measuring problem solving in computer environments: Current and future states. Computers in Human Behavior 2002, 18:609-622.
7. Barzilai S., Zohar A. How does information technology shape thinking?. Thinking Skills and Creativity 2006, 1:130-145.
8. Baumert J., Lüdtke O., Trautwein U., Brunner M. Large-scale student assessment studies measure the results of processes of knowledge acquisition: Evidence in support of the distinction between intelligence and student achievement. Educational Research Review 2009, 4:165-179.
9. Brown T.A. Confirmatory factor analysis for applied research 2006, The Guilford Press, New York, NY.
10. Brunner M., Süß H.-M. Analyzing the reliability of multidimensional measures: An example from intelligence research. Educational and Psychological Measurement 2005, 65:227-240.
11. Bühner M., Kröner S., Ziegler M. Working memory, visual-spatial-intelligence and their relationship to problem-solving. Intelligence 2008, 36:672-680.
12. Bulu S.T., Pedersen S. Supporting problem-solving performance in a hypermedia learning environment: The role of students' prior knowledge and metacognitive skills. Computers in Human Behavior 2012, 28:1162-1169.
13. Byrnes J.P. Cognitive development during adolescence. Blackwell handbook of adolescence 2003, 227-246. Blackwell Publishing, Malden, MA. G.R. Adams, M.D. Berzonsky (Eds.).
14. Carretero-Dios H., Eid M., Ruch W. Analyzing multitrait-multimethod data with multilevel confirmatory factor analysis: An application to the validation of the State-Trait Cheerfulness Inventory. Journal of Research in Personality 2011, 45:153-164.
15. Chen C.-H., Wu I.-C. The interplay between cognitive and motivational variables in a supportive online learning system for secondary physical education. Computers & Education 2012, 58:542-550.
16. Choi B., Baek Y. Exploring factors of media characteristic influencing flow in learning through virtual worlds. Computers & Education 2011, 57:2382-2394.
17. Danner D., Hagemann D., Holt D.V., Hager M., Schankin A., Wüstenberg S., et al. Measuring performance in dynamic decision making. Reliabilty and validity of the Tailorshop simulation. Journal of Individual Differences 2011, 32(4):225-233.
18. Danner D., Hagemann D., Schankin A., Hager M., Funke J. Beyond IQ: A latent state-trait analysis of general intelligence, dynamic decision-making, and implicit learning. Intelligence 2011, 39:323-334.
19. Danthiir V., Wilhelm O., Roberts R.D. Further evidence for a multifaceted model of mental speed: Factor structure and validity of computerized measures. Learning and Individual Differences 2012, 22:324-335.
20. Domagk S., Schwartz R.N., Plass J.L. Interactivity in multimedia learning: An integrated model. Computers in Human Behavior 2010, 26:1024-1033.
21. Eid M. A multitrait-multimethod model with minimal assumptions. Psychometrika 2000, 65(2):241-261.
22. Embretson S.E., Reise S.P. Item response theory for psychologists 2000, Lawrence Erlbaum, Mahwah, NJ.
23. Enders C.K. Applied missing data analysis 2010, The Guilford Press, New York.
24. Evans C., Gibbons N.J. The interactivity in multimedia learning. Computers & Education 2007, 49:1147-1160.
25. Friege G., Lind G. Types and qualities of knowledge and their relations to problem solving in physics. International Journal of Science and Mathematics Education 2006, 4:437-465.
26. Funke J. Problemlösendes Denken [Thinking Skills in Problem Solving] 2003, Kohlhammer, Stuttgart.
27. Funke J. Complex problem solving: A case for complex cognition?. Cognitive Processing 2010, 11:133-142.
28. Funke J., Frensch P.A. Complex problem solving: The European Perspective - 10 years after. Learning to solve complex scientific problems 2007, 25-47. Lawrence Erlbaum, New York, London. D.H. Jonassen (Ed.).
29. Gallagher C., Hipkins R., Zohar A. Positioning thinking within national curriculum and assessment systems: Perspectives from Israel. New Zealand and Northern Ireland. Thinking Skills and Creativity 2012, 7:134-143.
30. Gonzalez C., Dutt V. A generic dynamic control task for behavioral research and education. Computers in Human Behavior 2011, 27:1904-1914.
31. Goode N., Beckmann J.F. You need to know: There is a causal relationship between structural knowledge and control performance in complex problem solving tasks. Intelligence 2010, 38:345-352.
32. Hambrick D.Z. The role of domain knowledge in higher-level cognition. Handbook of understanding and measuring intelligence 2005, 361-372. Sage Publications, Thousand Oaks, CA. O. Wilhelm, R.W. Engle (Eds.).
33. Heller K.A., Perleth C. Kognitiver Fähigkeitstest für 4.-12. Klassen Revision (KFT 4-12+R) [Cognitive ability test for grades 4 to 12, revision (KFT 4-12+R)] 2000, Göttingen, Hogrefe.
34. Hoffman B., Schraw G. The influence of self-efficacy and working memory capacity on problem-solving efficacy. Learning and Individual Differences 2009, 19:91-100.
35. Hu L.-T., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6:1-55.
36. Jaarsveld S., Lachmann T., van Leeuwen C. Creative reasoning across developmental levels: Convergence and divergence in problem creation. Intelligence 2012, 40:172-188.
37. Jonassen D.H. Learning to solve problems. A handbook for designing problem-solving learning environments 2011, Routledge, New York, London.
38. Klahr D. Exploring science 2000, MIT Press, Cambridge, MA.
39. Kolen M.J., Brennan R.L. Test equating, scaling, and linking 2004, Springer Science+Business, New York, NY.
40. Köller O., Parchmann I. Competencies: The German notion of learning outcomes. Making it tangible - Learning outcomes in science education 2012, 165-185. Waxmann, Münster. S. Bernholt, K. Neumann, P. Nentwig (Eds.).
41. Koppelt J. Modellierung dynamischer Problemlösekompetenz im Chemieunterricht [Modeling dynamic problem-solving competency in chemistry education] 2011, Mensch & Buch, Berlin.
42. Krapp A., Prenzel M. Research on interest in science: Theories, methods and findings. International Journal of Science Education 2011, 33(1):27-50.
43. Kröner S., Plass J.L., Leutner D. Intelligence assessment with computer simulations. Intelligence 2005, 33:347-368.
44. Ku K. Assessing students' critical thinking performance: Urging for measurements using multi-response format. Thinking Skills and Creativity 2009, 4:70-76.
45. Kuhn D. Reasoning about multiple variables: Control of variables is not the only challenge. Science Education 2007, 91:710-726.
46. Künsting J., Wirth J., Paas F. The goal specificity effect on strategy use and instructional efficiency during computer-based scientific discovery learning. Computers & Education 2011, 56:668-679.
47. Laxman K. A conceptual framework mapping the application of information search strategies to well and ill-structured problem solving. Computers & Education 2010, 55:513-526.
48. Lee C.B., Jonassen D.H., Teo T. The role of model building in problem solving and conceptual change. Interactive Learning Environments 2011, 19:247-265.
49. Leutner D. The fuzzy relationship of intelligence and problem solving in computer simulations. Computers in Human Behavior 2002, 18:685-697.
50. Marsh H.W., Martin A.J. Academic self-concept and academic achievement: Relations and causal ordering. British Journal of Educational Psychology 2011, 81:59-77. 10.1348/000709910X503501.
51. Messick S. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist 1995, 50:741-749.
52. Molnár G., Greiff S., Csapó B. Inductive reasoning, domain specific and complex problem solving: Relations and development. Thinking Skills and Creativity 2013, 9:35-45.
53. Muthén B.O., Muthén L.K. Mplus 6 [Computer software] 2010, Muthén & Muthén, Los Angeles, CA.
54. Novick L.R., Bassok M. Problem solving. The Cambridge handbook of thinking and reasoning 2005, 321-349. University Press, Cambridge, NY. K.J. Holyoak, R.G. Morrison (Eds.).
55. OECD PISA 2006 Technical Report 2009, OECD Publications, Paris.
56. OECD PISA 2012 Assessment and Analytical Framework 2013, OECD, Paris.
57. Osborne J. The 21st century challenge for science education: Assessing scientific reasoning. Thinking Skills and Creativity 2013, 10.1016/j.tsc.2013.07.006.
58. Park S.I., Lee G.I., Kim M. Do students benefit equally from interactive computer simulations regardless of prior knowledge levels?. Computers & Education 2009, 52:649-655.
59. Piekny J., Maehler C. Scientific reasoning in early and middle childhood: The development of domain-general evidence evaluation, experimentation, and hypothesis generation skills. British Journal of Developmental Psychology 2012, 10.1111/j.2044-835X. 2012.02082.x.
60. Pohl S., Steyer R. Modeling common traits and method effects in multitrait-multimethod analysis. Multivariate Behavioral Research 2010, 45:45-72.
61. Ragni M., Löffler C.M. Complex problem solving: Another test case?. Cognitive Processing 2010, 11:159-170.
62. Rigas G., Carling E., Brehmer B. Reliability and validity of performance measures in microworlds. Intelligence 2002, 30:463-480.
63. Rozencwajg P., Fenouillet F. Effect of goal setting on the strategies used to solve a block design task. Learning and Individual Differences 2012, 22:530-536.
64. Rutten N., Van Joolingen W.R., Van der Veen J.T. The learning effects of computer simulations in science education. Computers & Education 2011, 58:136-153.
65. Scherer R. Analyse der Struktur, Messinvarianz und Ausprägung komplexer Problemlösekompetenz im Fach Chemie [Analyzing the structure, measurement invariance, and performance in complex problem-solving assessments in chemistry] 2012, Logos, Berlin.
66. Scherer R., Tiemann R. Factors of problem-solving competency in a virtual chemistry environment: The role of metacognitive knowledge about strategies. Computers & Education 2012, 59(4):1199-1214.
67. Schmitt T.A. Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment 2011, 29:304-321.
68. Schoppek W. Examples, rules, and strategies in the control of dynamic systems. Cognitive Science Quarterly 2002, 2:63-92.
69. Schroeders U. Testing for equivalence of test data across media. The transition to computer-based assessment 2009, 164-170. Office for Official Publications of the European Communities, Luxembourg. F. Scheuermann, J. Björnsson (Eds.).
70. Schroeders U., Wilhelm O. Testing reasoning ability with handheld computers, notebooks, and paper and pencil. European Journal of Psychological Measurement 2010, 26:284-292.
71. Sharma P., Hannafin M.J. Scaffolding in technology-enhanced learning environments. Interactive Learning Environments 2007, 15:27-46.
72. Shin N., Jonassen D.H., McGee S. Predictors of well-structured and ill-structured problem solving in an astronomy simulation. Journal of Research in Science Teaching 2003, 40:6-33.
73. Sonnleitner P., Keller U., Martin R., Brunner M. Students' complex problem-solving abilities: Their structure and relations to reasoning ability and educational success. Intelligence 2013, 41(5):289-305.
74. Sternberg R.J. Intelligence. International encyclopedia of education 2010, 184-190. Elsevier, Oxford. 3rd ed. P. Peterson, E. Baker, B. McGraw (Eds.).
75. Swanson H.L. Intellectual growth in children as a function of domain specific and domain general working memory subgroups. Intelligence 2011, 39:481-492.
76. Leutner D., Fleischer J., Wirth J., Greiff S., Funke J. Analytische und dynamische Problemlösekompetenz im Lichte internationaler Schulleistungsvergleichsstudien. Psychologische Rundschau 2012, 63(1):34-42.
77. Van der Kleij F.M., Eggen T.J.H.M., Timmers C.F., Veldkamp B.P. Effects of feedback in a computer-based assessment for learning. Computers & Education 2012, 58:263-272.
78. Van Merriënboer J.J.G. Perspectives on problem solving and instruction. Computers & Education 2013, 64:153-160.
79. Wellnitz N., Hartmann S., Mayer J. Developing a paper-and-pencil-test to assess students' skills in scientific inquiry. Contemporary science education research: Learning and assessment 2010, 289-294. Pegem Akademi, Ankara, Turkey. G. Cakmakci, M.F. Tasar (Eds.).
80. Wijekumar K.K., Jonassen D.H. The role of computer tools in experts' problem solving ill-structured problems. Computers in Human Behavior 2007, 23:664-704.
81. Wilhelm O. Measuring reasoning ability. Handbook of understanding and measuring intelligence 2005, 373-392. Sage Publications, Thousand Oaks, CA. O. Wilhelm, R.W. Engle (Eds.).
82. Wirth J., Klieme E. Computer-based assessment of problem solving competence. Assessment in Education: Principles, Policy and Practice 2004, 10:329-345.
83. Wu H.-L., Pedersen S. Integrating computer- and teacher-based scaffolds in science inquiry. Computers & Education 2011, 57:2352-2363.
84. Wüstenberg S., Greiff S., Funke J. Complex problem solving: More than reasoning?. Intelligence 2012, 40:1-14.
85. Xin Z., Zhang L. Cognitive holding power, fluid intelligence, and mathematical achievement as predictors of children's realistic problem solving. Learning and Individual Differences 2009, 19:124-129.
86. Yang Y., Green S.B. Coefficient alpha: A reliability coefficient for the 21st century?. Journal of Psychoeducational Assessment 2011, 29:377-392.
87. Zimmerman C. The development of scientific thinking skills in elementary and middle school. Developmental Review 2007, 27:172-223.
88. Zohar A. Scaling up higher order thinking in science classrooms: The challenge of bridging the gap between theory, policy and practice. Thinking Skills and Creativity 2013, 10.1016/j.tsc.2013.08.001.