Large-scale student assessment studies measure the results of processes of knowledge acquisition: Evidence in support of the distinction between intelligence and student achievement

Educational Research Review

Volumn 4, Issue 3, 2009, Pages 165-176

  Baumert, Jürgen ^a   Lüdtke, Oliver ^a   Trautwein, Ulrich ^a   Brunner, Martin ^b  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^b UNIVERSITY OF LUXEMBOURG   (Luxembourg)

Author keywords

Educational outcomes; Intelligence; Knowledge; Student assessment studies

Indexed keywords

EID: 69549124013     PISSN: 1747938X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.edurev.2009.04.002     Document Type: Review

References (90)

1. Adey P., Csapo B., Demetriou A., Hautamäki J., and Shayer M. Can we be intelligent about intelligence? Why education needs the concept of plastic general ability. Educational Research Review 2 (2007) 75-97
2. Artelt C., Stanat P., Schneider W., and Schiefele U. Lesekompetenz: Testkonzeption und Ergebnisse [Reading literacy: Test design and results]. In: Baumert J., Klieme E., Neubrand M., Prenzel M., Schiefele U., Schneider W., Stanat P., Tillmann K.-J., and Weiß M. (Eds). PISA 2000: Basiskompetenzen von Schülerinnen und Schülern im internationalen Vergleich (2001), Leske, Opladen 69-137
3. Baltes P.B., Staudinger U.M., and Lindenberger U. Lifespan psychology: Theory and application to intellectual functioning. Annual Review of Psychology 50 (1999) 471-507
4. Bast J., and Reitsma P. Analyzing the development of individual differences in terms of Matthew effects in reading: Results from a Dutch longitudinal study. Developmental Psychology 34 6 (1998) 1373-1399
5. Baumert, J., Bos, W., & Lehmann, R. (Eds.), (2000). Dritte Internationale Mathematik- und Naturwissenschaftsstudie: Mathematische und naturwissenschaftliche Bildung am Ende der Schullaufbahn, Bd. 1: Mathematische und naturwissenschaftliche Grundbildung am Ende der Pflichtschulzeit [Third international mathematics and natural science study. Mathematical and scientific education at the end of the school career, Vol. 1: Mathematical and scientific education at the end of the second year of secondary school]. Opladen: Leske + Budrich.
6. Baumert J., Roeder P.M., Gruehn S., Heyn S., Köller O., Rimmele R., Schnabel K., and Seipp B. Bildungsverläufe und psychosoziale Entwicklung im Jugendalter (BIJU) [Educational careers and psychosocial development in adolescence]. In: Treumann K.P., Neubauer G., Möller R., and Abel J. (Eds). Methoden und Anwendungen empirischer pädagogischer Forschung (1996), Waxmann, Münster 170-180
7. Baumert J., Trautwein U., and Artelt C. Schulumwelten: Institutionelle Bedingungen des Lehrens und Lernens [School environments: Institutional conditions of learning and instruction]. In: Baumert J., Artelt C., Klieme E., Neubrand M., Prenzel M., Schiefele U., Schneider W., Tillmann K.-J., and Weiß M. (Eds). PISA 2000: Ein differenzierter Blick auf die Länder der Bundesrepublik Deutschland (2003), Leske, Opladen 259-330
8. Becker, M., Lüdtke, O., Trautwein, U., Köller, O., & Baumert, J. (submitted for publication). The effect of schooling on psychometric intelligence: Does school quality make a difference?
9. Blum W. ICMI Study 14: Applications and modelling in mathematics education-discussion document. Educational Studies in Mathematics 51 (2002) 149-171
10. Borsboom D., Mellenbergh G.J., and van Heerden J. The concept of validity. Psychological Review 111 4 (2004) 1061-1071
11. Bosker R.J. The different levels of the g-factor. European Journal of Personality 21 (2007) 712-714
12. Brunner, M. (2005). Mathematische Schülerleistung: Struktur, Schulformunterschiede und Validität [Mathematics achievement: Structure, differences between academic tracks, and validity]. Doctoral Dissertation. Humboldt University, Berlin, Germany. From Retrieved 07.06.2006.
13. Brunner M. No g in education?. Learning and Individual Differences 18 (2008) 152-165
14. Brunner M., Lüdtke O., and Trautwein U. The internal/external frame of reference model revisited: Incorporating general cognitive ability and general academic self-concept. Multivariate Behavioral Research 43 (2008) 137-172
15. Brunner M., Krauss S., and Kunter M. Gender differences in mathematics: Does the story need to be rewritten?. Intelligence 36 (2008) 403-421
16. Cain K., Oakhill J., and Bryant P. Children's reading comprehension ability: Concurrent prediction by working memory, verbal ability, and component skills. Journal of Educational Psychology 96 (2004) 31-42
17. Carlstedt B. Differentiation of cognitive abilities as a function of level of general intelligence: A latent variable approach. Multivariate Behavioral Research 36 (2001) 589-609
18. Carroll J.B. Human cognitive abilities: a survey of factor analytic studies (1993), Cambridge University Press, New York
19. Cattell R.B. Intelligence: its structure, growth, and action (1987), Elsevier, Amsterdam
20. Ceci S.J. How much does schooling influence general intelligence and its cognitive components? A reassessment of the evidence. Developmental Psychology 27 (1991) 703-722
21. Cohen J. Statistical power analysis for the behavioral sciences (1988), Erlbaum, Hillsdale
22. Cole P.G. The bell curve: Should intelligence be used as the pivotal explanatory concept of student achievement?. Issues in Educational Research 5 (1995) 11-22
23. Cromley J.G., and Azevedo R. Testing and refining the direct and inferential mediation model of reading comprehension. Journal of Educational Psychology 99 (2007) 311-325
24. De Lange J. Real problems with real world mathematics. In: Alsina C., et al. (Ed). Proceedings of the 8th international congress on mathematical education, Sevilla July 1996 (1996), Thales, Sevilla 83-110
25. Educational Testing Service (ETS). TOEFL 1997 edition. Test & score manual (1997), ETS, Princeton, NJ
26. Francis D.J., Snow C.E., August D., Carlson C.D., Miller J., and Iglesias A. Measures of reading comprehension: A latent variable analysis of the diagnostic assessment of reading comprehension. Scientific Studies of Reading 10 (2006) 301-322
27. Freudenthal H. Didactical phemonology of mathematical structures (1983), Reidel, Dordrecht
28. Frey M.C., and Detterman D.K. Scholastic assessment or g? The relationship between the scholastic assessment test and general cognitive ability. Psychological Science 15 (2004) 373-378
29. Ganzeboom H.B.G., de Graaf P.M., Treimann D.J., and de Leeuw J. A standard international socio-economic index of occupational status. Social Science Research 21 (1992) 1-56
30. Ghisletta P., and Lindenberger U. Age-based structural dynamics between perceptual speed and knowledge in the Berlin Aging Study: Direct evidence for ability dedifferentiation in old age. Psychology and Aging 18 (2003) 696-713
31. Goldstein H. International comparisons of student attainment: Some issues arising from the PISA study. Assessment in Education 11 (2004) 319-330
32. Gorin J.S., and Embretson S.E. Item difficulty modeling of paragraph comprehension items. Applied Psychological Measurement 30 (2006) 394-411
33. Gottfredson L.S. Mainstream science on intelligence: An editorial with 52 signatories, history and bibliography. Intelligence 24 (1997) 13-23
34. Gottfredson L.S. G, jobs and life. In: Nyborg H. (Ed). The scientific study of general intelligence: Tribute to Arthur R. Jensen. (2003), Pergamon Press, Amsterdam, Netherlands 293-342
35. Graesser A.C., Gernsbacher M.A., and Goldman S.R. Cognition. In: van Dijk T.A. (Ed). Discourse as structure and process. Discourse studies: A multidisciplinary introduction Vol. 1 (1997), Sage, London 292-319
36. Graesser A.C., Millis K.K., and Zwaan R.A. Discourse comprehension. Annual Review of Psychology 48 (1997) 163-189
37. Graesser A.C., Singer M., and Trabasso T. Constructing inferences during narrative text comprehension. Psychological Review 101 (1994) 371-395
38. Gustafsson J.E. A unifying model for the structure of intellectual abilities. Intelligence 8 (1984) 179-203
39. Gustafsson J.E. Hierarchical models of individual differences in cognitive abilities. In: Sternberg R.J. (Ed). Advances in the psychology of human intelligence Vol. 4 (1988), Erlbaum, Hillsdale, NJ 35-72
40. Gustafsson J., and Balke G. General and specific abilities as predictors of school achievement. Multivariate Behavioral Research 28 (1993) 407-434
41. Gustafsson J.E., and Undheim J.O. Individual differences in cognitive functions. In: Berliner D.C., and Calfee R.C. (Eds). Handbook of educational psychology (1996), Macmillan, New York 186-242
42. Hannon B., and Daneman M. A new tool for measuring and understanding individual differences in the component processes of reading comprehension. Journal of Educational Psychology 93 (2001) 103-128
43. Härnqvist K., Gustafsson J.-E., Muthén B., and Nelson G. Hierarchical models of ability at individual and class levels. Intelligence 18 (1994) 165-187
44. Heckman J.J. Lessons from the bell curve. The Journal of Political Economy 103 (1995) 1091-1120
45. Heller K.A., and Perleth C. Kognitiver Fähigkeitstest für 4. bis 12. Klassen, Revision. Manual [Cognitive abilities test for grades 4-12, Revision, Manual] (2000), Hogrefe, Göttingen
46. Helmke A., and Weinert F.E. Bedingungsfaktoren schulischer Leistungen [Conditions of student learning outcomes]. In: Weinert F.E. (Ed). Enzyklopädie der Psychologie: Vol. 3. Psychologie des Unterrichts und der Schule (1997), Hogrefe, Göttingen 71-176
47. Horn J.L., and Noll J. Human cognitive capabilities: Gf-Gc theory. In: Flanagan D.P., Genshaft J.L., and Harrison P.L. (Eds). Contemporary intellectual assessment. Theories, tests, and issues (1997), The Guilford Press, New York 53-91
48. Jensen A.R. Psychometric g: Definition and substantiation. In: Sternberg R.J., and Grigorenko E.L. (Eds). The general factor of intelligence: How general is it? (2002), Erlbaum, Mahwah, NJ 39-53
49. King G. A solution to the ecological inference problem (1997), Princeton University Press, Princeton, NJ
50. Kintsch W. Comprehension: A paradigm for cognition (1998), Cambridge University Press, Cambridge, UK
51. Kirsch I.S. Literacy performance on three scales: Definition and results. In: OECD/Statistics Canada (Ed). Literacy, economy and society: Results of the first international adult literacy survey (1995), OECD, Paris pp. 27-53
52. Kirsch I.S., Jungeblut A., and Mosenthal P.B. The measurement of adult literacy. In: Murray T.S., Kirsch I.S., and Jenkins L. (Eds). Adult literacy in OECD Countries: Technical report on the first international adult literacy survey (1998), U.S. Department of Education, National Center for Education Statistics, Washington, DC
53. In: Köller O., Watermann R., Trautwein U., and Lüdtke O. (Eds). Wege zur Hochschulreife in Baden-Württemberg. Tosca-Eine Untersuchung an allgemein bildenden und beruflichen Gymnasien [Paths leading to the school-leaving qualification in Baden-Württemberg. TOSCA-An investigation at traditional and vocational gymnasium schools] (2004), Leske, Opladen
54. Lehmann, R., & Nikolova, R. (2004). Erhebung zum Lese- und Mathematikverständnis - Entwicklung in den Jahrgangsstufen 4 bis 6 in Berlin (ELEMENT): Bericht über die Untersuchung 2003 an Berliner Grundschulen und grundständigen Gymnasien [The ELEMENT study of reading and mathematics literacy: Report on the 2003 assessment of Berlin elementary and gymnasium schools]. Berlin: Senatsverwaltung für Bildung, Jugend und Sport.
55. Luo D., Thompson L.A., and Detterman D.K. The causal factor underlying the correlation between psychometric g and scholastic performance. Intelligence 31 1 (2003) 67-83
56. Maaz K., Trautwein U., Lüdtke O., and Baumert J. Educational transitions and differential learning environments: How explicit between-school tracking contributes to social inequality. Child Development Perspectives 2 (2008) 87-94
57. Mayer R.E. Mathematical ability. In: Sternberg R.J. (Ed). Human abilities. An information-processing approach (1985), W.H. Freeman and Company, New York 127-150
58. Mayer R.E., and Hegarty M. The process of understanding mathematical problems. In: Sternberg R.J., and Ben-Zeev T. (Eds). The nature of mathematical thinking (1996), Lawrence Erlbaum Associates, Mahwah, NJ 29-53
59. Nagy, G. (2006). Berufliche Interessen, kognitive und fachgebundene Kompetenzen: Ihre Bedeutung für die Studienfachwahl und die Bewährung im Studium [Vocational interests, cognitive and scholastic abilities: Their role in choice of major and success at university]. Unpublished doctoral dissertation, Free University, Berlin, Germany.
60. Nathan M.J., Kintsch W., and Young E. A theory of algebra-word-problem comprehension and its implications for the design of learning environments. Cognition and Instruction 9 (1992) 329-389
61. National Council of Teachers of Mathematics. Principles and standards for school mathematics (2000), NCTM, Reston, VA
62. Neisser U., Boodoo G., Bouchard T.J.J., Boykin A.W., Brody N., Ceci S.J., Halpern D.F., Loehlin J.C., Perloff R., Sternberg R.J., and Urbina S. Intelligence: Knowns and unknowns. American Psychologist 51 (1996) 77-101
63. Neubrand J., and Neubrand M. Innere Strukturen mathematischer Leistung im PISA-2000-Test [Internal structures of mathematics achievement in the PISA 2000 test]. In: Neubrand M. (Ed). Mathematische Kompetenzen von Schülerinnen und Schülern in Deutschland: Vertiefende Analysen im Rahmen von PISA 2000 (2004), VS Verlag für Sozialwissenschaften, Wiesbaden
64. Organisation for Economic Co-operation, and Development (OECD). Measuring student knowledge and skills: A new framework for assessment (1999), Author, Paris
65. Organisation for Economic Co-operation, and Development (OECD). Learning for tomorrow's world. First results from PISA 2003 (2004), Author, Paris
66. Ostroff C. Comparing correlations based on individual-level and aggregated data. Journal of Applied Psychology 78 (1993) 569-582
67. Perfetti C.A. Psycholinguistics and reading ability. In: Gernsbacher M.A. (Ed). Handbook of psycholinguistics (1994), Erlbaum, Hillsdale, NJ 849-894
68. In: Prenzel M., Baumert J., Blum W., Lehmann R., Leutner D., Neubrand M., Pekrun R., Rost J., and Schiefele U. (Eds). PISA 2003. Untersuchungen zur Kompetenzentwicklung im Verlauf eines Schuljahres (2003), Waxmann, Münster
69. Raven J., Raven J.C., and Court J.H. Manual for Raven's Progressive Matrices and Vocabulary Scales (1998), Oxford Psychologists Press, London
70. Rindermann H. Was messen internationale Schulleistungsstudien? Schulleistungen, Schülerfähigkeiten, kognitive Fähigkeiten, Wissen oder allgemeine Intelligenz? [What do international student assessment studies measure? School performance, student abilities, cognitive abilities, knowledge, or general intelligence?]. Psychologische Rundschau 57 (2006) 69-86
71. Rindermann H. The g-factor of international cognitive ability comparisons: The homogeneity of results in PISA, TIMSS, PIRLS and IQ-tests across nations. European Journal of Personality 21 (2007) 667-706
72. Robinson W.S. Ecological correlations and behavior of individuals. American Sociological Review 15 (1950) 351-357
73. Rubman C.N., and Waters H.S. A, B seeing: The role of constructive processes in children's comprehension monitoring. Journal of Educational Psychology 92 (2000) 503-514
74. Rupp A.A., Ferne T., and Choi H. How assessing reading comprehension with multiple-choice questions shapes the construct: A cognitive processing perspective. Language Testing 23 (2006) 441-474
75. Schmalhofer F., and Glavanov D. Three components of understanding a programmer's manual: Verbatim, propositional, and situational representations. Journal of Memory and Language 25 (1986) 279-294
76. Schnotz W., and Dutke S. Kognitionspsychologische Grundlagen der Lesekompetenz [Cognitive psychological foundations of reading literacy]. In: Schiefele U., Artelt C., Schneider W., and Stanat P. (Eds). Struktur, Entwicklung und Förderung von Lesekompetenz (2004), VS Verlage für Sozialwissenschaften, Wiesbaden 61-99
77. Shen C., and Pedulla J.J. The relationship between students' achievement and their self-perception of competence and rigour of mathematics and science: A cross-national analysis. Assessment in Education 7 (2000) 237-253
78. Sekretariat der Ständigen Konferenz der Kultusminister der Länder in der Bundesrepublik Deutschland. Beschlüsse der Kultusministerkonferenz. Bildungsstandards im Fach Mathematik für den Mittleren Schulabschluss. Beschluss vom 4. 12. 2003 [Resolutions of the standing conference of the ministers of education and cultural affairs: Educational standards in mathematics for lower secondary school level. Resolution of December 4, 2003] (2004), Wolters Kluwer, München
79. Snow R.E., and Lohman D.F. Implications of cognitive psychology for educational measurement. In: Linn R.L. (Ed). Educational measurement. 3rd ed. (1989), American Council on Education and Macmillan Publishing Company, New York 263-331
80. Spearman C. The abilities of man (1927), The Macmillan Company, New York
81. Stanat P., and Lüdtke O. Multilevel issues in international large-scale assessment studies on student performance. In: van de Vijver F.J.R., van Hemert D.A., and Poortinga Y.H. (Eds). Individuals and cultures in multilevel analysis (2008), Erlbaum, Hillsdale, NJ 315-344
82. Sternberg R.J. Contemporary theories of intelligence. In: Reynolds W.M., and Miller G.E. (Eds). Handbook of psychology. Educational psychology (2003), Wiley, Hoboken, NJ 23-46
83. Trautwein U., Köller O., Lehmann R., and Lüdtke O.(Hrsg.). Schulleistungen von Abiturienten: Regionale, schulformbezogene und soziale Disparitäten [School achievement of students at gymnasium schools: Regional, track-specific and social disparaties] (2007), Waxmann, Münster
84. van Dijk T.A., and Kintsch W. Strategies of discourse comprehension (1983), Academic Press, New York
85. Warm T.A. Weighted likelihood estimation of ability in item response theory. Psychometrika 54 (1989) 427-450
86. Weinert F.E. Concept of competence: A conceptual clarification. In: Rychen D.S., and Salganik L.H. (Eds). Defining and selecting key competencies (2001), Hogrefe & Huber Publishers, Seattle 45-66
87. Weinert F.E. Schooling: Impact on cognitive and motivational development. In: Smelser N., and Baltes P.B. (Eds). International encyclopedia of the social and behavioral sciences (2004), Elsevier, Oxford 13589-13594
88. Weinert F.E., and Helmke A. Interclassroom differences in instructional quality and interindividual differences in cognitive development. Educational Psychologist 30 (1995) 15-20
89. Weiß R.H. Grundintelligenztest Skala 2 (CFT 20) [Culture fair intelligence test]. 4th ed. (1998), Westermann Test, Göttingen
90. Zwaan R.A., and Radvansky G.A. Situation models in language and memory. Psychological Bulletin 123 (1998) 162-185