Complex problem solving and intelligence: A meta-analysis

Intelligence

Volumn 53, Issue , 2015, Pages 92-101

  Stadler, Matthias ^a   Becker, Nicolas ^b   Gödker, Markus ^a   Leutner, Detlev ^c   Greiff, Samuel ^a  

^a UNIVERSITY OF LUXEMBOURG   (Luxembourg)

^b SAARLAND UNIVERSITY   (Germany)

^c UNIVERSITY OF DUISBURG ESSEN   (Germany)

Author keywords

Complex problem solving; Dynamic decision making; Intelligence; Meta analysis; Multiple complex systems

Indexed keywords

EID: 84943545332     PISSN: 01602896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intell.2015.09.005     Document Type: Article

References (62)

1. Becker N., Preckel F., Karbach J., Raffel N., Spinath F.M. Die Matrizenkonstruktionsaufgabe. Diagnostica 2015, 61:22-33. 10.1026/0012-1924/a000111.
2. Beckmann J.F. Lernen und komplexes Problemlösen. Ein Beitrag zur Konstruktvalidierung von Lerntests 1994, Holos, Bonn, Germany. 10.1080/02724980143000262.
3. Beckmann J., Guthke J. Complex problem solving. Intelligence and learning ability. Complex problem solving: The European perspective 1995, 177-200. 10.4324/9781315806723. P.A. Frensch, J. Funke (Eds.).
4. Begg C.B., Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994, 5:1088-1101. 10.2307/2533446.
5. Borenstein M., Hedges L.V., Higgins J.P.T., Rothstein H.R. Introduction to Meta-Analysis 2009, Wiley, Chichester.
6. Brehmer B. Dynamic decision making: Human control of complex systems. Acta Psychologica 1992, 81:211-241. 10.1016/0001-6918(92)90019-a.
7. Cook R.D., Weisberg S. Residuals and influence in regression 1982, Chapman and Hall, New York.
8. Danner D. Cognitive ability beyond IQ 2011, Doctoral dissertation, University of Heidelberg, (Retrieved from http://www.ub.uni-heidelberg.de/archiv/12574).
9. Dörner D., Kreuzig H.W. Problemlösefähigkeit und Intelligenz. Psychologische Rundschau 1983, 34:185-192. 10.7771/1932-6246.1118.
10. Lohhausen: Vom Umgang mit Unbestimmtheit und Komplexität 1983, Huber, Bern, (Retrieved from http://www.verlag-hanshuber.com/). D. Dörner, H.W. Kreuzig, F. Reither, T. Stäudel (Eds.).
11. Elshout J.J. Problem solving and education. Learning and instruction 1987, 259-273. Pergamon, Oxford, (Retrieved from http://ukcatalogue.oup.com/). E. DeCorte, H. Lodewijks, R. Parmentier, P. Span (Eds.).
12. Field A.P. The problems in using fixed-effects models of meta-analysis on real-world data. Understanding Statistics 2003, 2:77-96. 10.1207/s15328031us0202_02.
13. Field A.P. Is the meta-analysis of correlation coefficients accurate when population coefficients vary?. Psychological Methods 2005, 1:444-467. 10.1037/1082-989x.10.4.444.
14. Field A.P., Gillett R. How to do a meta-analysis. British Journal of Mathematical and Statistical Psychology 2010, 63:665-694. 10.1348/000711010x502733.
15. Complex problem solving: The European perspective 1995, Erlbaum, Hillsdale, NJ, (Retrieved from http://www.psypress.com/). P.A. Frensch, J. Funke (Eds.).
16. Funke J. Dynamic systems as tools for analysing human judgement. Thinking & Reasoning 2001, 7:69-89. 10.1080/13546780042000046.
17. Funke J., Frensch P.A. Complex problem solving: The European perspective - 10years after. Learning to solve complex scientific problems 2007, Lawrence Erlbaum Associates. D.H. Jonassen (Ed.).
18. Gonzalez C., Thomas R.P., Vanyukov P. The relationships between cognitive ability and dynamic decision making. Intelligence 2005, 33:169-186. 10.1016/j.intell.2004.10.002.
19. Greiff S., Stadler M., Sonnleitner P., Wolff C., Martin R. Sometimes less is more: Comparing the validity of complex problem solving measures. Intelligence 2015, 50:100-113. 10.1016/j.intell.2015.02.007.
20. Greiff, S. (2012). Individualdiagnostik der Problemlösefähigkeit [Diagnostics of problem solving ability on an individual level]. Münster, Germany: Waxmann . doi:10.5539/jedp.v2n1p49.
21. Greiff S., Fischer A., Wüstenberg S., Sonnleitner P., Brunner M., Martin R. A multitrait-multimethod study of assessment instruments for complex problem solving. Intelligence 2013, 41:579-596. 10.1016/j.intell.2013.07.012.
22. Greiff S., Fischer A., Stadler M., Wüstenberg S. Assessing complex problem-solving skills with multiple complex systems. Thinking & Reasoning 2014, 1-27. (ahead-of-print). 10.1080/13546783.2014.989263.
23. Greiff S., Wüstenberg S., Funke J. Dynamic problem solving - A new assessment perspective. Applied Psychological Measurement 2012, 36:189-213. 10.1177/0146621612439620.
24. Hall J.A., Rosenthal R. Testing for moderator variables in meta-analysis: Issues and methods. Communication Monographs 1991, 58:437-448. 10.1080/03637759109376240.
25. Hedges L.V. Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics 1981, 6:107-128. 10.3102/10769986006002107.
26. Hedges L.V., Vevea J.L. Fixed- and random-effects models in meta-analysis. Psychological Methods 1998, 3:486-504. 10.1037/1082-989x.3.4.486.
27. Higgins J., Thompson S.G., Deeks J.J., Altman D.G. Measuring inconsistency in meta-analyses. British Medical Journal 2003, 327:557-560. 10.1136/bmj.327.7414.557.
28. Hunter J.E., Schmidt F.L. Methods of meta-analysis. Correcting error and bias in research findings 2004, Sage Publications, Newburypark, CA. 2nd ed., 10.1177/1094428106295494.
29. IBM IBM SPSS Statistics for Windows, Version 20.0.0 2011, IBM, Armonk, NY.
30. Jäger A.O., Süß H.M., Beauducel A. Berliner Intelligenzstruktur-Test. Form 4 1997, Hogrefe, Göttingen, Germany, (Retrieved from http://www.hogrefe.de/).
31. Joslyn S., Hunt E. Evaluating individual differences in response to time-pressure situations. Journal of Experimental Psychology: Applied 1998, 4:16-43. 10.1037/1076-898X.4.1.16.
32. Kluwe R.H., Misiak C., Haider H. The control of complex systems and performance in intelligence tests. Intelligence: reconceptualization and measurement 1991, 227-244. Lawrence Erlbaum, Hillsdale, NJ. H. Rowe (Ed.).
33. Kröner S. Intelligenzdiagnostik per Computersimulation 2001, Waxmann Verlag.
34. Kröner S., Plass J.L., Leutner D. Intelligence assessment with computer simulations. Intelligence 2005, 33:347-368. 10.1016/j.intell.2005.03.002.
35. Leutner D. The fuzzy relationship of intelligence and problem solving in computer simulations. Computers in Human Behavior 2002, 18:685-697. 10.1016/s0747-5632(02)00024-9.
36. Leutner D., Klieme E., Meyer K., Wirth J. Problemlösen (Problem solving]. PISA 2003: Der Bildungsstand der Jugendlichen in Deutschland - Ergebnisse des zweiten internationalen Vergleichs 2004, 147-175. Waxmann, Münster, (Retrieved from http://www.waxmann.com/). PISA-Konsortium Deutschland (Ed.).
37. Mayer H., Hazotte C., Djaghloul Y., Latour T., Sonnleitner P., Brunner M., Martin R. Using complex problem solving simulations for general cognitive ability assessment: The Genetics Lab framework. International Journal of Information Science and Intelligent System 2013, 2:71-88. (Retrieved from http://www.ijisis.org/).
38. McGrew K.S. CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research. Intelligence 2009, 37:1-10. 10.1016/j.intell.2008.08.004.
39. Neubert J.C., Kretzschmar A., Wüstenberg S., Greiff S. Extending the assessment of complex problem solving to finite state automata. Embracing heterogeneity. European Journal of Psychological Assessment 2014, 31(3):181-194. 10.1027/1015-5759/a000224.
40. Overton R.C. A comparison of fixed-effects and mixed (random-effects) models for meta-analysis tests of moderator variable effects. Psychological Methods 1998, 3:354-379. 10.1037/1082-989x.3.3.354.
41. Putz-Osterloh W. Selbstreflexionen. Testintelligenz und interindividuelle Unterschiede bei der Bewältigung komplexer Probleme. Sprache & Kognition 1985, 4:203-216.
42. R Core Team R: A language and environment for statistical computing 2015, R Foundation for Statistical Computing, Vienna, Austria, (http://www.R-project.org/).
43. Raaheim K. Intelligence and task novelty. Advances in the psychology of human intelligence 1988, Vol. 4:73-97. Erlbaum, Hillsdale, NJ, (Retrieved from http://www.psypress.com/). R.J. Sternberg (Ed.).
44. Raven J.C., Raven J.C., De Lemos M.M. Standard progressive matrices 1958, Lewis, London.
45. Rigas G., Brehmer B. Mental processes in intelligence tests and dynamics decision making tasks. Judgment and decision making: Neo-Brunswikian and process-tracing approaches 1999, 45-65. Lawrence Erlbaum, Hillsdale, NJ. P. Juslin, H. Montgomerry (Eds.).
46. Rigas G., Carling E., Brehmer B. Reliability and validity of performance measures in microworlds. Intelligence 2002, 30:463-480. 10.1016/s0160-2896(02)00121-6.
47. Sonnleitner P., Brunner M., Greiff S., Funke J., Keller U., Martin R., Latour T. The Genetics Lab: Acceptance and psychometric characteristics of a computer-based microworld assessing complex problem solving. Psychological Test and Assessment Modeling 2012, 54:54-72.
48. Scherer R., Greiff S., Hautamäki J. Exploring the relation between time on task and ability in complex problem solving. Intelligence 2015, 48:37-50. 10.1016/j.intell.2014.10.003.
49. Schoppek W. Spiel und Wirklichkeit - Reliabilität und Validität von Verhaltensmustern in komplexen Situationen. Sprache & Kognition 1991, 10:15-27.
50. Sternberg R.J., Berg C.A. Quantitative integration: Definitions of intelligence: A comparison of the 1921 and 1986 symposia. What is intelligence 1986, 155-162. Ablex, Norwood, NJ. R.J. Sternberg, D.K. Detterman (Eds.).
51. Süß H.M., Kersting M., Oberauer K. Intelligenz und Wissen als Prädiktoren für Leistungen bei computersimulierten komplexen Problemen. Diagnostica 1991, 37:334-352.
52. Süß H.M. Intelligenz, Wissen und Problemlösen. Kognitive Voraussetzungen für erfolgreiches Handeln bei computersimulierten Problemen 1996, Hogrefe, Göttingen.
53. Sweeney L.B., Sterman J.D. Bathtub dynamics: Initial results of a systems thinking inventory. System Dynamics Review 2000, 16:249-286. 10.1002/sdr.198.
54. Vevea J.L., Woods C.M. Publication bias in research syntheses: Sensitivity analysis using a priory weight functions. Psychological Methods 2005, 1:428-443. 10.1037/1082-989x.10.4.428.
55. Viechtbauer W. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 2010, 36:1-48. (http://www.jstatsoft.org/v36/i03/).
56. Viechtbauer W., Cheung M.W.-L. Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods 2010, 1:112-125. 10.1002/jrsm.11.
57. Wagener D. Psychologische Diagnostik mit komplexen Szenarios 2001, Pabst, Lengerich.
58. Wirth J., Klieme E. Computernutzung. Deutsches PISA-Konsortium (Hrsg.), PISA 2000. Ein differenzierter Blick auf die Länder der Bundesrepublik Deutschland (S. 195-209) 2003.
59. Wittmann W.W., Süß H.M. Investigating the paths between working memory, intelligence, knowledge, and complex problem-solving performances via Brunswik symmetry. Learning and individual differences: Process, trait, and content determinants 1999, 77-108. American Psychological Association, Washington, DC. 10.1037/10315-004. R.D. Roberts (Ed.).
60. Wittmann W.W., Hattrup K. The relationship between performance in dynamic systems and intelligence. Systems Research and Behavioral Science 2004, 21:393-409. 10.1002/sres.653.
61. Wüstenberg S., Greiff S., Funke J. Complex problem solving - More than reasoning?. Intelligence 2012, 40:1-14. 10.1016/j.intell.2011.11.003.
62. Wüstenberg S., Stadler M., Hautamäki J., Greiff S. The role of strategy knowledge for the application of strategies in complex problem solving tasks. Technology, Knowledge and Learning 2014, 19(1-2):127-146. 10.1007/s10758-014-9222-8.