Exploring the Relation between Time on Task and Ability in Complex Problem Solving

Intelligence

Volumn 48, Issue , 2015, Pages 37-50

  Scherer, Ronny ^a   Greiff, Samuel ^b   Hautamäki, Jarkko ^c  

^a UNIVERSITY OF OSLO   (Norway)

^b UNIVERSITY OF LUXEMBOURG   (Luxembourg)

^c UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Complex Problem Solving; Goal Orientations; MicroDYN; Reasoning; Time on task

Indexed keywords

EID: 84909594822     PISSN: 01602896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intell.2014.10.003     Document Type: Article

References (59)

1. Baumert J., Lüdtke O., Trautwein U., Brunner M. Large-scale student assessment studies measure the results of processes of knowledge acquisition: Evidence in support of the distinction between intelligence and student achievement. Educational Research Review 2009, 4:165-175.
2. Bipp T., Steinmayr R., Spinath B. A functional look at goal orientations: Their role for self-estimates of intelligence and performance. Learning and Individual Differences 2012, 22:280-289.
3. Bryant F., Satorra A. Principles and practice of scaled difference chi-square testing. Structural Equation Modeling: A Multidisciplinary Journal 2012, 19:372-398.
4. Buchner A. Basic topics and approaches to the study of complex problem solving. Complex Problem Solving: The European Perspective 1995, 27-63. Erlbaum, Hillsdale, NJ. P.A. Frensch, J. Funke (Eds.).
5. Danner D., Hagemann D., Schankin A., Hager M., Funke J. Beyond IQ: A latent state-trait analysis of general intelligence, dynamic decision making, and implicit learning. Intelligence 2011, 39:323-334.
6. Demetriou A., Spanoudis G., Shayer M. Developmental intelligence: From empirical to hidden constructs. Intelligence 2013, 41:744-749.
7. Dodonova Y., Dodonov Y. Processing speed and intelligence as predictors of school achievement: Mediation or unique contribution?. Intelligence 2012, 40:163-171.
8. Dodonova Y., Dodonov Y. Faster on easy items, more accurate on difficult ones: Cognitive ability and performance on a task of varying difficulty. Intelligence 2013, 41:1-10.
9. Elliot A., Dweck C. Competence and motivation: Competence as the core of achievement motivation. Handbook of Competence and Motivation 2005, 3-12. The Guildford Press, New York, NY. A. Elliot, C. Dweck (Eds.).
10. Enders C. Applied Missing Data Analysis 2010, The Guilford Press, New York, NY.
11. Evans J., Stanovich K. Dual-process theories of higher cognition: Advancing the debate. Perspectives on Psychological Science 2013, 8:223-241.
12. Fox J.-P. Bayesian Item Response Modeling 2010, Springer, New York.
13. Fox J.-P., Klein Entink R.H., van der Linden W. Modeling of responses and response times with the package cirt. Journal of Statistical Software 2007, 20:1-14.
14. Funke J. Complex problem solving: A case for complex cognition?. Cognitive Processing 2010, 11:133-142.
15. Goldhammer F., Klein Entink R. Speed of reasoning and its relation to reasoning ability. Intelligence 2011, 39:108-119.
16. Goldhammer F., Naumann J., Stelter A., Rölke H., Klieme E. The time on task effect in reading and problem solving is moderated by task difficulty and skill: Insights from a computer-based large-scale assessment. Journal of Educational Psychology 2014, 106:608-626.
17. Greiff S., Fischer A., Wüstenberg S., Sonnleitner P., Brunner M., Martin R. A multitrait-multimethod study of assessment instruments for Complex Problem Solving. Intelligence 2013, 41:579-596.
18. Greiff S., Wüstenberg S., Funke J. Dynamic Problem Solving: A new measurement perspective. Applied Psychological Measurement 2012, 36:189-213.
19. Greiff S., Wüstenberg S., Molnár G., Fischer A., Funke J., Csapó B. Complex problem solving in educational contexts - something beyond g: Concept, assessment, measurement invariance, and construct validity. Journal of Educational Psychology 2013, 105:364-379.
20. Grewal R., Cote R., Baumgartner H. Multicollinearity and measurement error in structural equation models: Implications for theory testing. Marketing Science 2004, 23:519-529.
21. Hautamäki J., Arinen P., Eronen S., Hautamäki A., Kupiainen S., Lindblom B., et al. Assessing Learning-to-learn: A Framework 2002, National Board of Education, Helsinki.
22. Huang C. Discriminant and criterion-related validity of achievement goals in predicting academic achievement: A meta-analysis. Journal of Educational Psychology 2012, 104:48-73.
23. Inhelder B., Piaget J. The Early Growth of Logic in the Child 1958, Routledge & Kegan Paul, London.
24. Jonassen D. Learning to Solve Problems 2011, Routledge, New York, NY.
25. Kolen M., Tong Y. Psychometric properties of IRT proficiency estimates. Educational Measurement: Issues and Practice 2010, 29:8-14.
26. Kupiainen S., Vainikainen M., Marjanen J., Hautamäki J. The role of time on task in computer-based low-stakes assessment of cross-curricular skills. Journal of Educational Psychology 2014, 106:627-638.
27. Lee Y.-H., Chen H. A review of recent response-time analyses in educational testing. Psychological Test and Assessment Modeling 2011, 53:359-379.
28. Leighton J. Defining and describing reason. The Nature of Reasoning 2004, 3-11. Cambridge University Press, Cambrigde, UK. J. Leighton, R. Sternberg (Eds.).
29. Marsh H., Hau K., Grayson D. Goodness of fit evaluation in structural equation modeling. Contemporary Psychometrics 2005, 275-340. Erlbaum, Mahwah, NJ. A. Maydeu-Olivares, J. McArdle (Eds.).
30. Mayer R. Problem solving and reasoning. International Encyclopedia of Education 2010, 273-278. Elsevier, Oxford. 3rd ed. P. Peterson, E. Baker, B. McGraw (Eds.).
31. Molnár G., Greiff S., Csapó B. Inductive reasoning, domain specific and complex problem solving: relations and development. Thinking Skills and Creativity 2013, 9:35-45.
32. Muthén L., Muthén B. Mplus 7.2 1998-2014, [Computer software], Muthén & Muthén, Los Angeles, CA.
33. Novick L., Bassok M. Problem solving. The Cambridge Handbook of Thinking and Reasoning 2005, 321-349. University Press, Cambridge, NY. K.J. Holyoak, R.G. Morrison (Eds.).
34. OECD Literacy, Numeracy and Problem Solving in Technology-Rich Environments: Framework for the OECD Survey of Adult Skills 2012, OECD Publishing, Paris.
35. OECD PISA 2012 Assessment and Analytical Framework 2013, OECD Publishing, Paris.
36. OECD PISA 2012 results: Creative problem solving: Students' skills in tackling real-life problems (Volume V) 2014, OECD Publishing, Paris.
37. Osborne J., Overbay A. The power of outliers. Practical Assessment, Research & Evaluation 2004, 9:6.
38. Osman M. The effects of self set or externally set goals on learning in an uncertain environment. Learning and Individual Differences 2012, 22:575-584.
39. Ranger J. A note on the hierarchical model for responses and response times in tests of van der Linden (2007). Psychometrika 2013, 78:538-544.
40. Rindermann H., Neubauer A. The influence of personality on three aspects of cognitive performance: processing speed, intelligence and school performance. Personality and Individual Differences 2001, 30:829-842.
41. Rindermann H., Neubauer A. Processing speed, intelligence, creativity, and school performance: Testing of causal hypotheses using structural equation modeling. Intelligence 2004, 32:573-589.
42. Ross J., Ross C. Ross Test of Higher Cognitive Processes 1976, Academic Therapy Publications, Novato, CA.
43. Saccuzzo D., Johnson N., Guertin T. Information processing in gifted versus nongifted African American, Latino, Filipino, and White children: Speeded versus nonspeeded paradigms. Intelligence 1994, 19:219-243.
44. Scherer R., Tiemann R. Factors of problem-solving competency in a virtual chemistry environment: The role of metacognitive knowledge about strategies. Computers & Education 2012, 59:1199-1214.
45. Schneider W., McGrew K. The Cattell-Horn-Carroll Model of Intelligence. Contemporary Intelligence Assessment 2012, 99-144. Guilford Press, New York, NY. 3rd ed. D. Flanagan, P. Harrison (Eds.).
46. Schweizer F., Wüstenberg S., Greiff S. Validity of the MicroDYN approach: Complex problem solving predicts school grades beyond working memory capacity. Learning and Individual Differences 2013, 24:42-52.
47. Shayer M. Has Piaget's Construct of Formal Operational Thinking any Utility?. British Journal of Educational Psychology 1979, 49:265-276.
48. Sonnleitner P., Keller U., Martin R., Brunner M. Students' complex problem-solving abilities: Their structure and relations to reasoning ability and educational success. Intelligence 2013, 41:289-305.
49. Tuominen-Soini H., Salmela-Aro K., Niemivirta M. Achievement goal orientations and subjective well-being: A person-centred analysis. Learning and Instruction 2008, 18:251-266.
50. Vainikainen M.-P. Finnish primary school pupils' performance in learning to learn assessments: A longitudinal perspective on educational equity. University of Helsinki, Department of Teacher Education Research Reports 2014, 360. Picaset, Helsinki.
51. van Buuren S., Goorthius-Oudshoorn K. Multivariate imputation by chained equations (mice). R package version 2.18 2013, (http://cran.r-project.org/web/packages/mice/index.html).
52. van der Linden W. A hierachical framework for modeling speed and accuracy on test items. Psychometrika 2007, 72:287-308.
53. Vernon P., Nador S., Kantor L. Reaction times and speed-of-processing: Their relationship to timed and untimed measures of intelligence. Intelligence 1985, 9:357-374.
54. Wetzels R., Wagenmakers E.-J. A default Bayesian hypothesis test for correlations and partial correlations. Psychonomic Bulletin & Review 2012, 19:1057-1064.
55. Wirth J., Leutner D. Self-regulated learning as a competence. Journal of Psychology 2008, 216:102-110.
56. Wirthwein L., Sparfeldt J., Pinquart M., Wegerer J., Steinmayr R. Achievement goals and academic achievement: A closer look at moderating factors. Educational Research Review 2013, 10:66-89.
57. Wüstenberg S., Greiff S., Funke J. Complex problem solving: More than reasoning?. Intelligence 2012, 40:1-14.
58. Wüstenberg S., Stadler M., Hautamäki J., Greiff S. The role of strategy knowledge for the application of strategies in complex problem solving tasks. Technology, Knowledge and Learning 2014, 19:127-146.
59. Yang Y., Green S. Coefficient Alpha: A reliability coefficient for the 21st century?. Journal of Psychoeducational Assessment 2011, 29:377-392.