The negative effect of school-average ability on science self-concept in the UK, the UK countries and the world: The Big-Fish-Little-Pond-Effect for PISA 2006

Educational Psychology

Volumn 31, Issue 5, 2011, Pages 629-656

  Nagengast, Benjamin ^a   Marsh, Herbert W ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Academic self concept; Big Fish Little Pond Effect; Doublylatent multilevel models; PISA

Indexed keywords

EID: 79960299135     PISSN: 01443410     EISSN: 14695820     Source Type: Journal    
DOI: 10.1080/01443410.2011.586416     Document Type: Article

References (86)

1. Adams, R.J., & Wu, M. (2002). PISA 2000 technical report. Paris: OECD.
2. Alicke, M.D., Zell, E., & Bloom, D. (2010). Mere categorization and the frog pond effect. Psychological Science, 21, 174-177.
3. Asparouhov, T. (2006). General multi-level modelling with sampling weights. Communications in Statistics-Theory and Methods, 35, 439-460.
4. Asparouhov, T. (2008). Scaling of sampling weights for two level models in Mplus 4.2. Los Angeles, CA: Muthén and Muthén.
5. Bauer, D.J., & Cai, L. (2009). Consequences of unmodeled nonlinear effects in multilevel models. Journal of Educational and Behavioral Statistics, 34, 97-114.
6. Buckingham, J.T., & Alicke, M.D. (2002). The influence of individual versus aggregate social comparison information on self-evaluations. Journal of Personality and Social Psychology, 83, 1117-1130.
7. Byrne, B.M., & Shavelson, R.J. (1986). On the structure of adolescent self-concept. Journal of Adolescent Psychology, 78, 474-481.
8. Carle, A. (2009). Fitting multilevel models in complex survey data with design weights: Recommendations. BMC Medical Research Methodology, 9, 49.
9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
10. Craven, R.G., Marsh, H.W., & Burnett, P. (2003). Cracking the self-concept enhancement conundrum: A call and blueprint for the next generation of self-concept enhancement research. In H.W. Marsh, R.G. Craven & D.M. McInerney (Eds.), International advances in self research (Vol. 1, pp. 91-126). Greenwich, CT: Information Age.
11. Craven, R.G., Marsh, H.W., & Debus, R.L. (1991). Effects of internally focused feedback and attributional feedback on enhancement of academic self-concept. Journal of Educational Psychology, 83, 17-27.
12. Dumay, X., & Dupriez, V. (2008). Does the school composition effect matter? Evidence from Belgian data. British Journal of Educational Studies, 56, 440-477.
13. Enders, C.K., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121-138.
14. ESRC Teaching and Learning Research Programme. (2006). Science education in schools. Issues, evidence and proposals. London: Institute of Education.
15. Goldstein, H., & McDonald, R.P. (1988). A general-model for the analysis of multilevel data. Psychometrika, 53, 455-467.
16. Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576.
17. Guay, F., Larose, S., & Boivin, M. (2004). Academic self-concept and educational attainment level: A ten-year longitudinal study. Self and Identity, 3, 53-68.
18. Guay, F., Marsh, H.W., & Boivin, M. (2003). Academic self-concept and academic achievement: Developmental perspectives on their causal ordering. Journal of Educational Psychology, 95, 124-136.
19. Haney, P., & Durlak, J.A. (1998). Changing self-esteem in children and adolescents: A meta-analytic review. Journal of Clinical Child Psychology, 27, 423-433.
20. Harker, R., & Tymms, P. (2004). The effects of student composition on school outcomes. School Effectiveness and School Improvement, 15, 177-199.
21. Hattie, J.A.C. (2002). Classroom composition and peer effects. International Journal of Educational Research, 37, 449-481.
22. Hattie, J.A.C. (2009). Visible learning. A synthesis of over 800 meta-analyses relating to achievement. London: Routledge.
23. Hox, J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Erlbaum.
24. Ireson, J., & Hallam, S. (2009). Academic self-concepts in adolescence. Relations with achievement and ability grouping in schools. Learning and Instruction, 19, 201-213.
25. Ireson, J., Hallam, S., & Plewis, I. (2001). Ability grouping in secondary schools: Effects on pupils' self-concepts. British Journal of Educational Psychology, 71, 315-326.
26. Kreft, I.G.G., de Leeuw, J., & Aiken, L.S. (1995). The effect of different forms of centering in hierarchical linear models. Multivariate Behavioral Research, 30, 1-21.
27. Kulik, C.L. (1985). Effects of inter-class ability grouping on achievement and self-esteem. Paper presented at the 1985 annual meeting of the American Psychological Association, Los Angeles.
28. Kulik, C.L., & Kulik, J.A. (1982). Effects of ability grouping on secondary school students: A metaanalysis of evaluation findings. American Educational Research Journal, 21, 799-806.
29. Liem, G.A. D, Marsh, H.W., Martin, A.J., McInerney, D.M., & Yeung, A.S. (2010). The big fish little pond effect and ability-streaming: Effects of within-school ability grouping, moderators, and gender and ethnicity referents. Paper presented at the 2010 International Congress of Applied Psychology, July 2010, Melbourne, Australia.
30. Lüdtke, O., Marsh, H.W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B.O. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203-229.
31. Lüdtke, O., Marsh, H. W., Robitzsch, A., & Trautwein, U. (in press). A 2_2 taxonomy of multilevel latent contextual models: Accuracy and bias trade-offs in full and partial error-correction models. Psychological Methods.
32. Marsh, H.W. (1984). Self-concept, social comparison, and ability grouping: A reply to Kulik and Kulik. American Educational Research Journal, 21, 799-806.
33. Marsh, H.W. (1987). The big-fish-little-pond effect on academic self-concept. Journal of Educational Psychology, 79, 280-295.
34. Marsh, H.W. (1991). Failure of high-ability high schools to deliver academic benefits commensurate with their students' ability levels. American Educational Research Journal, 28, 445-480.
35. Marsh, H.W. (2006). Self-concept theory, measurement and research into practice. The role of self-concept in educational psychology. Leicester, UK: British Psychological Society.
36. Marsh, H.W., Chessor, D., Craven, R., & Roche, L. (1995). The effects of gifted and talented programs on academic self-concept: The big fish strikes again. American Educational Research Journal, 32, 285-319.
37. Marsh, H.W., & Craven, R.G. (2002). The pivotal role of frames of reference in academic selfconcept formation: The big-fish-little-pond effect. In F. Pajares & T. Urdan (Eds.), Adolescence and education (Vol. 2, pp. 83-123). Greenwich, CT: Information Age.
38. Marsh, H.W., & Craven, R.G. (2006). Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science, 1, 133-163.
39. Marsh, H.W., Craven, R., & Debus, R. (1998). Structure, stability, and development of young children's self-concepts. Child Development, 69, 1030-1053.
40. Marsh, H.W., & Hau, K. (2003). Big-fish-little-pond effect on academic self-concept. A cross-cultural (26-country) test of the negative effects of academically selective schools. American Psychologist, 58, 364-376.
41. Marsh, H.W., & Hau, K.-T. (2007). Applications of latent-variable models in educational psychology: The need for methodological-substantive synergies. Contemporary Educational Psychology, 32, 151-171.
42. Marsh, H.W., Hau, K.-T., Balla, J.R., & Grayson, D. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33, 181-220.
43. Marsh, H.W., Hau, K.-T., & Grayson, D. (2005). Goodness of fit evaluation in structural equation modeling. In A. Maydeu-Olivares & J. McArdle (Eds.), Psychometrics: A festschrift to Roderick P. McDonald pp. 275-340). Mahwah, NJ: Lawrence Erlbaum.
44. Marsh, H.W., Hau, K.-T., Artelt, C., Baumert, J., & Peschar, J.L. (2006). OECD's brief self-report measure of educational psychology's most useful affective constructs: Cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing. 6, 311-360.
45. Marsh, H.W., Kong, C.-K., & Hau, K.-T. (2000). Longitudinal multilevel models of the big-fish-little-pond effect on academic self-concept: Counterbalancing contrast and reflected-glory effects in Hong Kong schools. Journal of Personality and Social Psychology, 78, 337-349.
46. Marsh, H.W., Lüdtke, O., Muthén, B.O., Asparouhov, T., Morin, A.J.S., Trautwein, U., & Nagengast, B. (2010). A new look at the big-five factor structure through exploratory structural equation modeling. Psychological Assessment, 22, 471-491.
47. Marsh, H.W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthén, B.O., & Nagengast, B. (2009). Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44, 764-802.
48. Marsh, H.W., Muthén, B.O., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A.J.S., & Trautwein, U. (2009). Exploratory Structural Equation Modeling, integrating CFA and EFA: Application to students 'evaluations of university teaching. Structural Equation Modeling, 16, 439-476.
49. Marsh, H.W., & Parker, J. (1984). Determinants of student self-concept: Is it better to be a relatively large fish in a small pond even if you don't learn to swim as well? Journal of Personality and Social Psychology, 47, 213-231.
50. Marsh, H.W., & O'Mara, A. (2010). Long-term total negative effects of school-average ability on diverse educational outcomes: Direct and indirect effects of the big-fish-little-pond effect. German Journal of Educational Psychology, 24, 51-72.
51. Marsh, H.W., & Rowe, K.J. (1996). The negative effects of school-average ability on academic self-concept: An application of multilevel modelling. Australian Journal of Education, 40, 65-87.
52. Marsh, H.W., Seaton, M., Kuyper, H., Dumas, F., Huguet, P., Regner, I., Buunk, A.P., Monteil, J.M., Blanton, H., & Gibbons, F.X. (2010). Phantom behavioral assimilation effects: Systematic biases in social comparison choice studies. Journal of Personality, 78, 671-710.
53. Marsh, H.W., Seaton, M., Trautwein, U., Lüdtke, O., Hau, K.T., O'Mara, A.J., & Craven, R.G. (2008). The big-fish-little-pond effect stands up to critical scrutiny: Implications for theory, methodology, and future research. Educational Psychology Review, 3, 319-350.
54. Marsh, H.W., Tracey, D.K., & Craven, R.G. (2006). Multidimensional self-concept structure for preadolescents with mild intellectual disabilities: A hybrid multigroup-mimic approach to factorial invariance and latent mean differences. Educational and Psychological Measurement, 66, 795-818.
55. Marsh, H.W., Trautwein, U., Lüdtke, O., Baumert, J., & Köller, O. (2007). Big fish little pond effect: Persistent negative effects of selective high schools on self-concept after graduation. American Educational Research Journal, 44, 631-669.
56. Marsh, H.W., Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2006). Integration of multidimensional self-concept and core personality constructs: Construct validation and relations to well-being and achievement. Journal of Personality, 74, 403-456.
57. Marsh, H.W., & Yeung, A.S. (1997a). Coursework selection: Relations to academic self-concept and achievement. American Educational Research Journal, 34, 691-720.
58. Marsh, H.W., & Yeung, A.S. (1997b). Causal effects of academic self-concept on academic achievement: Structural equation models of longitudinal data. Journal of Educational Psychology, 89, 41-54.
59. McDonald, R.P. (1993). A general-model for 2-level data with responses missing at random. Psychometrika, 58, 575-585.
60. McDonald, R.P. (1994). The bilevel reticular action model for path-analysis with latent-variables. Sociological Methods & Research, 22, 399-413.
61. Mehta, P.D., & Neale, M.C. (2005). People are variables too: Multilevel structural equation modeling. Psychological Methods, 10, 259-284.
62. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525-543.
63. Muthén, L.K., & Muthén, B.O. (1998-2007). Mplus user's guide (5th ed.). Los Angeles, CA: Muthén & Muthén.
64. National Foundation for Educational Research. (2009). Overview of education systems in England, Wales and Northern Ireland. Retrieved from http://www.nfer.ac.uk.
65. O'Mara, A.J., Marsh, H.W., Craven, R.J., & Debus, R. (2006). Do self-concept interventions make a difference? A synergistic blend of construct validation and meta-analysis. Educational Psychologist, 41, 181-206.
66. Organisation for Economic Co-operation and Development. (2003). Student engagement at school: A sense of belonging and participation. Paris: Organisation for Economic Co-operation and Development.
67. Organisation for Economic Co-operation and Development. (2005). PISA 2003 technical report. Paris: Organisation for Economic Co-operation and Development.
68. Organisation for Economic Co-operation and Development. (2007). PISA 2006 science competencies for tomorrow's world. Paris: Organisation for Economic Co-operation and Development.
69. Organisation for Economic Co-operation and Development. (2009a). PISA 2006 technical report. Paris: Organisation for Economic Co-operation and Development.
70. Organisation for Economic Co-operation and Development. (2009b). PISA data analysis manual (2nd ed. ed.). Paris: Organisation for Economic Co-operation and Development.
71. Rabe-Hesketh, S., Skrondal, A., & Pickles, A. (2004). Generalized multilevel structural equation modeling. Psychometrika, 69, 167-190.
72. Raudenbush, S.W., & Bryk, A.S. (2002). Hierarchical linear models: Application and data analysis methods (2nd ed. ed.). Thousand Oaks, CA: Sage.
73. Roberts, G. (2002). SET for success: The supply of people with science, technology, engineering and mathematics, skills. London: HM Treasury.
74. Schafer, J.L. (1997). Analysis of incomplete multivariate data. Boca Raton, FL: Chapman & Hall.
75. Schagen, I., & Schagen, S. (2005). Combining multilevel analysis with national value-added data sets-a case study to explore the effects of school diversity. British Educational Research Journal, 31, 309-328.
76. Seaton, M., Marsh, H.W., & Craven, R.G. (2009). Earning its place as a pan-human theory: Universality of the big-fish-little-pond effect across 41 culturally diverse countries. Journal of Educational Psychology, 101, 403-419.
77. Seaton, M., Marsh, H.W., & Craven, R.G. (2010). Big-Fish-Little-Pond-Effect: Generalizability and moderation-Two sides of the same coin. American Educational Research Journal, 47, 390-433.
78. Shavelson, R.J., Hubner, J.J., & Stanton, G.C. (1976). Self-concept: Validation of construct interpretations. Review of Educational Research, 46, 407-441.
79. Shin, Y., & Raudenbush, S.W. (2010). A latent cluster-mean approach to the contextual effects model with missing data. Journal of Educational and Behavioral Statistics, 35, 26-53.
80. Stapleton, L. (2006). An assessment of practical solutions for structural equation modelling with complex sample data. Structural Equation Modeling, 13, 28-58.
81. Tracey, D.K., Marsh, H.W., & Craven, R.G. (2003). Self-concepts of preadolescent students with mild intellectual disabilities: Issues of measurement and educational placement. In H.W. Marsh, R.G. Craven & D.M. McInerney (Eds.), International advances in self research (Vol. 1, pp. 203-30). Greenwich, CT: Information Age.
82. Trautwein, U., Lüdtke, O., Marsh, H.W., & Nagy, G. (2009). Within-school social comparison: Perceived class prestige predicts academic self-concept. Journal of Educational Psychology, 101, 853-866.
83. Tymms, P. (2001). A test of the big fish in a little pond hypothesis: An investigation into the feelings of seven-year-old pupils in school. School Effectiveness and School Improvement, 12, 161-181.
84. Valentine, J.C., & DuBois, D.L. (2005). Effects of self-beliefs on academic achievement and vice versa. In H.W. Marsh, R.G. Craven & D.M. McInerney (Eds.), The new frontiers of self research pp. 53-77). Greenwich, CT: Information Age.
85. Widaman, K.F., & Reise, S.P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In K.J. Bryant, M. Windle & S.G. West (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research pp. 281-324). Washington, DC: American Psychological Association.
86. Zell, E., & Alicke, M.D. (2009). Contextual neglect, self-evaluation, and the frog pond effect. Journal of Personality and Social Psychology, 97, 467-482.